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Abstract 

Guided  collective  motion  of  cooperating  vehicles  was  addressed  in  this  project  through  the  use  of 
heterogeneous  guidance  gains.  Two  different  approaches  were  examined  for  this  purpose.  In  the  first 
we  assumed  all-to-all  communication  between  agents  and  proposed  strategies  that  allowed  the  agent 
swarm  to  converge  to  specified  points  in  the  environment.  Several  strategies  were  tried  out  for  this 
purpose  using  balanced  and  splay  formation  objectives.  The  second  approach  was  to  exploit  the  cyclic 
pursuit  strategy  where  the  connections  are  with  one  leader  and  one  follower  and  a  similar 
heterogeneous  gains  and  hierarchical  structure  was  exploited  to  achieve  convergence  at  arbitrary 
points  in  space. 

Introduction 

Collective  motion  of  particles  is  an  area  that  has  attracted  the  attention  of  the  multi-agent  cooperative 
control  community  of  researchers.  Designing  cooperative  control  strategies  that  exploit  symmetry  and 
homogeneity  of  the  system  to  achieve  collective  motion  under  global  or  partial  communication 
network  was  the  main  challenge  addressed  by  these  researchers.  However,  the  property  of 
homogeneity  is  never  realized  in  a  real  system.  There  exist  results  that  show  the  robustness  of  these 
control  strategies  even  under  heterogeneity.  However,  the  heterogeneity  that  these  works  consider  is 
related  to  the  heterogeneity  in  the  dynamics  of  the  systems. 

In  this  proposal,  we  examined  this  issue  of  heterogeneity  from  the  point  of  view  of  introducing 
heterogeneity  in  the  control  strategy  in  order  to  achieve  some  desired  behavior.  For  example, 
collective  motion  aims  to  achieve  consensus  in  terms  of  a  target  point  about  which  the  particles  (or 
vehicles  -  UAVs,  AUVs,  or  robots  -  with  simple  dynamics)  achieve  a  equally  spaced  circular  motion, 
or  consensus  in  terms  of  a  common  direction  of  parallel  movement.  However,  in  any  real  applications 
it  is  necessary  to  specify  a  desired  point  about  which  this  collective  motion  should  occur  or  specify  a 
path  along  which  the  parallel  motion  to  occur.  In  the  literature,  the  task  of  guiding  collective  motion 
has  been  done  by  introducing  the  angle  of  movement  in  the  parallel  motion  control  strategy  and  then 
switching  off  the  parallel  motion  strategy  and  switching  on  the  circular  motion  strategy  when  the 
formation  approximately  reaches  the  desired  target  poin.  In  another  approach  this  has  been  achieved 
by  introducing  a  flow  field. 

In  the  proposed  work  we  aim  to  achieve  these  requirements  of  target  point  surveillance  by  circular 
motion  or  parallel  motion  along  a  desired  path  by  introducing  heterogeneity  in  the  system  in  terms  of 
non-homogeneous  control  gains.  The  advantage  is  that  explicit  commands  to  the  vehicles  about  the 
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intended  target  point  or  path  can  be  avoided.  Instead,  controller  gains  can  be  made  to  serve  the  same 
objective  while  camouflaging  their  intention  from  an  adversary. 


Techniques  and  Approach 

We  have  used  two  different  paradigms  to  achieve  the  task  of  collective  motion  under  heterogeneous 
guidance  gains.  One  of  them  uses  an  all-to-all  communication  framework  between  agents  and 
attempts  to  achieve  point  convergence  as  well  as  collective  motion  in  balanced  and  splay  formations 
about  a  target  point  of  interest.  The  second  approach  uses  a  cyclic  pursuit  paradigm  that  requires  each 
agent  to  have  a  leader  and  a  follower.  This  has  been  further  generalized  in  terms  of  heterogeneous 
guidance  gains,  multiple  leaders  and  followers,  hierarchical  structures,  and  single  and  double 
integrator  dynamics.  The  major  results  for  these  have  been  described  below. 


Results  and  Discussion 


In  the  all-to-all  communication  framework  the  following  results  have  been  obtained. 

Collective  Motion  with  Heterogeneous  Controllers:  In  this  work,  we  study  the  collective  motion  of 
individually  controlled  planar  particles  when  they  are  coupled  through  heterogeneous  controller  gains. 
Two  types  of  collective  formations,  synchronization  and  balancing,  are  described  and  analyzed  under 
the  influence  of  these  heterogeneous  controller  gains.  These  formations  are  characterized  by  the 
motion  of  the  centroid  of  the  group  of  particles.  In  synchronized  formation,  the  particles  and  their 
centroid  move  in  a  common  direction,  while  in  balanced  formation  the  movement  of  particles 
possesses  a  fixed  location  of  the  centroid.  We  show  that,  by  selecting  suitable  controller  gains,  these 
formations  can  be  controlled  significantly  to  obtain  not  only  a  desired  direction  of  motion  but  also  a 
desired  location  of  the  centroid.  We  present  the  results  for  N-particles  in  synchronized  formation, 
while  in  balanced  formation  our  analysis  is  confined  to  two  and  three  particles. 

Stabilization  of  Balanced  Circular  Motion:  In  this  work,  we  study  the  collective  motion  of  a  group  of 
N  (>=2)  identical  agents  trying  to  achieve  a  circular  formation  centered  at  a  desired  location,  which  is 
fixed.  A  circular  formation  is  characterized  by  the  motion  of  all  agents  around  the  same  circle  in  the 
same  direction.  To  solve  this  problem,  we  propose  a  planar  motion  model  that  incorporates  two 
control  inputs.  One  of  the  control  inputs  is  chosen  independently  and  the  other  control  input  is  decided 
by  using  the  composite  Lyapunov  function.  We  show  that  the  desired  location  of  the  center  of  this 
circular  formation,  which  is  fixed,  is  obtained  by  directing  the  centroid  of  the  group  of  agents  to  that 
desired  location.  This  leads  to  a  collective  formation  of  all  the  agents,  known  as  balanced  circular 
formation.  The  theoretical  findings  are  supported  by  simulations. 


In  the  cyclic  pursuit  framework  the  following  results  have  been  obtained. 

Reachability  with  double  integrator  dynamics:  A  new  law  is  proposed  which  guarantees  stability  for 
agents  with  double  integrator  dynamics.  An  algorithm  is  proposed  which  enables  rendezvous  of  the 
agents  at  any  desired  point  in  the  two-dimensional  space.  The  gains  corresponding  to  each  agent  are 
different  and,  along  with  their  initial  velocities,  are  considered  to  be  the  decision  variables. 

Global  Reachability  and  Target  Capturability:  Global  reachability  of  agents  under  a  cyclic  pursuit 
framework  has  been  discussed  and  a  potential  application  of  the  expansion  in  reachable  set  has  been 
pointed  out  with  respect  to  capture  of  a  moving  target.  Agents  with  double  integrator  dynamics  have 
also  been  considered. 

General  Hierarchical  Pursuit:  In  this  work,  a  variant  of  cyclic  pursuit,  called  hierarchical  cyclic  pursuit, 
has  been  considered.  The  underlying  information  flow  graph  that  connects  the  agents  is  hierarchical  in 
nature.  In  prior  work,  the  gains  corresponding  to  each  agent  were  considered  equal.  This  work 
generalizes  the  existing  results  in  the  form  of  heterogeneity  in  the  gains,  and  presents  some  results  on 
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the  reachability  of  the  agents  in  hierarchical  cyclic  pursuit.  It  has  been  shown  that  the  existing  results 
may  be  obtained  as  special  cases  of  the  one  considered  here. 


Deviated  Cyclic  Pursuit:  This  work  addresses  and  analyses  deviated  linear  cyclic  pursuit  in  which  an 
agent  pursues  its  leader  with  an  angle  of  deviation.  The  sufficient  conditions  for  the  stability  of  such 
systems  are  presented  in  this  paper  along  with  the  derivation  of  the  reachable  set,  which  is  a  set  of 
points  where  the  agents  may  converge  asymptotically.  Both  continuous  time  and  discrete  time  cases 
are  considered 

Synchronous  and  Asynchronous  Cyclic  Pursuit:  In  the  existing  literature,  cyclic  pursuit  has  been 
mostly  considered  in  the  continuous  time  framework  and  all  the  results  have  been  derived  based  on 
the  continuous  time  model.  However,  in  most  practical  applications  and  implementations,  the  systems 
under  consideration  are  of  discrete  time  in  nature.  This  is  because  sampled  data  has  to  be  used  for 
computation  purposes.  The  discrete  time  model  of  cyclic  pursuit  calls  for  some  new  approaches  and 
techniques  because  the  synchronization  between  the  agents  determines  the  stability  of  the  system.  This 
work  provides  some  stability  results  for  heterogeneous  cyclic  pursuit  in  the  discrete  time  domain  by 
considering  both  synchronous  and  asynchronous  frameworks. 

Synchronized,  Balanced  and  Splay  Phase  Arrangements:  This  work  proposes  a  design  methodology  to 
stabilize  collective  circular  motion  of  a  group  of  N-identical  agents  moving  at  unit  speed  around 
individual  circles  of  different  radii  and  different  centers.  The  collective  circular  motion  studied  in  this 
paper  is  characterized  by  the  clockwise  rotation  of  all  agents  around  a  common  circle  of  desired  radius 
as  well  as  center,  which  is  fixed.  Our  interest  is  to  achieve  those  collective  circular  motions  in  which 
the  phases  of  the  agents  are  arranged  either  in  synchronized,  in  balanced  or  in  splay  formation.  In 
synchronized  formation,  the  agents  and  their  centroid  move  in  a  common  direction  while  in  balanced 
formation,  the  movement  of  the  agents  ensures  a  fixed  location  of  the  centroid.  The  splay  state  is  a 
special  case  of  balanced  formation,  in  which  the  phases  are  separated  by  multiples  of  2pi/N.  We 
derive  the  feedback  controls  and  prove  the  asymptotic  stability  of  the  desired  collective  circular 
motion  by  using  Lyapunov  theory  and  the  LaSalle’s  Invariance  principle. 

Achieving  a  Stationary  or  Moving  Centroid:  In  this  work,  we  study  the  problem  of  a  formation  of 
agents  trying  to  achieve  a  desired  collective  centroid,  which  might  be  stationary  or  moving.  The 
stabilization  of  the  collective  centroid  to  the  fixed  desired  location  leads  to  a  balanced  formation  of  the 
agents  about  that  point.  Similarly,  the  centroid  of  the  system  of  agents  may  be  needed  to  move  along  a 
certain  given  trajectory.  For  this,  the  centroid  of  the  formation  must  converge  to  the  desired  trajectory. 
To  solve  this  problem,  we  propose  a  planar  motion  model  that  explicitly  incorporates  a  controlled 
parameter.  We  also  provide  the  results  for  the  synchronized  formation  where  the  agents,  along  with 
that  of  their  centroid,  move  in  a  common  velocity  direction.  Simulation  results  are  presented  to 
support  the  theoretical  findings. 

Achieving  Desired  Angular  Frequency:  In  this  work,  we  consider  two  types  of  collective  formations: 
(i)  synchronized  circular  formation  and  (ii)  balanced  circular  formation.  These  formations  are 
characterized  by  the  motion  of  the  centroid  of  the  group  of  agents.  In  synchronized  circular  formation, 
the  agents  and  their  centroid  rotate  on  their  individual  circles  in  a  common  direction,  while  in 
balanced  circular  formation,  the  circling  of  the  agents  gives  rise  to  a  fixed  location  of  the  centroid.  We 
show  that  the  agents,  having  heterogeneously  distributed  initial  angular  frequencies,  can  be  made  to 
stabilize  to  synchronized  and  balanced  circular  formations  at  a  desired  angular  frequency.  Also,  the 
radius  of  these  circular  formations  can  be  controlled  significantly  by  controlling  their  desired  angular 
frequency.  We  further  extend  the  analysis  to  prove  the  stabilization  of  balanced  circular  formation  at 
the  desired  angular  frequency,  and  to  achieve  a  desired  location  of  the  centroid. 
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Collective  Behavior  with  Heterogeneous  Controllers 

Anoop  Jain^  and  Debasish  Ghose^ 


Abstract — In  this  paper,  we  study  the  collective  motion  of 
individually  controlled  planar  particles  when  they  are  coupled 
through  heterogeneous  controller  gains.  Two  types  of  collective 
formations,  synchronization  and  balancing,  are  described  and 
analyzed  under  the  Influence  of  these  heterogeneous  controller 
gains.  These  formations  are  characterized  by  the  motion  of  the 
centroid  of  the  group  of  particles.  In  synchronized  formation, 
the  particles  and  their  centroid  move  in  a  common  direction, 
while  in  balanced  formation  the  movement  of  particles  possess 
a  fixed  location  of  the  centroid.  We  show  that,  by  selecting 
suitable  controller  gains,  these  formations  can  be  controlled 
significantly  to  obtain  not  only  a  desired  direction  of  motion  but 
also  a  desired  location  of  the  centroid.  We  present  the  results 
for  A'-particles  in  synchronized  formation,  while  in  balanced 
formation  our  analysis  is  confined  to  two  and  three  particles. 

I.  Introduction 

Formation  control  of  Unmanned  Aerial  Vehicles  (UAVs) 
and  Autonomous  Underwater  Vehicles  (AUVs)  has  emerged 
as  a  growing  area  of  research  because  of  its  applications 
to  various  missions  such  as  surveillance,  search  and  data 
collection  [1],  [2],  The  particle  model  [3]  of  these  vehicles 
provides  a  simple  design  methodology  to  analyze  their 
collective  motion  [4] -[9].  This  paper  deals  with  two  types 
of  collective  motions:  synchronization  and  balancing,  for 
all-to-all  heterogeneously  coupled  particles.  Synchronization 
refers  to  the  situation  when,  at  all  times,  the  particles  and 
their  centroid,  which  is  the  average  position  of  the  group  of 
particles,  have  a  common  velocity  direction.  On  the  other 
hand,  balancing  refers  to  the  situation  in  which  the  particles 
move  in  such  a  way  that  their  centroid  remains  fixed.  In 
balanced  formation,  the  centroid  is  called  the  convergence 
point  to  distinguish  its  motion  in  synchronized  formation. 

The  present  work  is  inspired  by  the  problem  addressed 
in  [10],  which  proposed  a  steering  control  law  to  stabi¬ 
lize  synchronized  and  balanced  formations.  The  proposed 
control  law  operates  with  homogeneous  controller  gains  for 
individually  controlled  particles.  This  type  of  homogeneous 
coupling  among  agents  limits  its  applications  in  the  field 
of  aerial  and  underwater  vehicles.  As  an  extension  in  this 
paper,  it  is  assumed  that  the  particles  are  heterogeneously 
coupled,  and  that  the  controller  gains  can  be  deterministically 
varied.  In  [11],  the  authors  have  shown  that  the  meeting 
point  (rendezvous)  of  multiple  agents  in  linear  cyclic  pursuit 
can  be  decided  by  selecting  proper  heterogenous  gains.  The 
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analytical  results  that  relate  the  heterogenous  controller  gains 
to  the  direction  of  movement  of  the  agents  when  the  system  is 
unstable,  are  derived  in  [12],  A  more  general  case,  where  the 
speeds  and  controller  gains  for  the  different  agents  may  vary, 
is  discussed  in  [13],  In  the  present  paper,  some  interesting 
possibilities  regarding  the  synchronized  and  balanced  forma¬ 
tions  based  on  the  assumption  of  heterogeneous  coupling  are 
presented. 

II.  Analysis  of  Heterogeneous  Controller  Gains 

In  the  literature  [10],  [14],  [15],  collective  dynamics  of 
multiple  autonomous  agents  is  studied  through  the  particle 
model  in  which  each  individual  is  represented  by  a  particle 
having  unit  mass.  In  [10],  the  authors  introduce  a  model  of 
steering  particles  moving  with  unit  speed  as: 

4  =  0k  =  Uk,  k=l,...,N  (1) 

Here,  the  position  of  the  Uth  particle  is  rk=Xk  +  iyk,  while 
the  velocity  of  the  fe-th  particle  is  Vk  =  =  cos  Gk  +  i  sin  Gk, 

where,  Gk  denotes  the  orientation  of  the  (unit)  velocity  vector 
of  the  k-th  particle  from  the  positive  x-axis.  The  orientation 
of  the  velocity  vector  is  also  referred  to  as  the  phase  of  the 
particle,  which  is  motivated  from  the  problem  of  achieving 
synchronization  in  coupled  oscillators  [16],  [17]. 

The  steering  control  Uk  is  a  feedback  control  law  for  the  k- 
th  particle.  If,  for  all  ^  =  1, . . . ,  A,  the  control  Uk  is  identically 
zero,  then  each  particle  travels  in  a  straight  line  in  its  initial 
direction  0^(0).  If,  on  the  other  hand,  for  all  k= 

Uk  =  (Oo  is  constant  but  not  zero,  then  each  particle  travels 
on  a  circle  with  radius  |  ft>o  |  *  ■ 

The  control  of  the  average  linear  momentum  of  the  group 
plays  an  important  role  in  the  controller  design  methodology 
[10].  The  average  linear  momentum  po  of  a  group  of 
particles  satisfying  (1)  is, 

1  N  1  TV 

=  (2) 

k=i  k=\ 

The  magnitude  \p0\  satisfies  0  ^  I/jqI  ^  1.  In  the  particle 
model  defined  by  (1),  synchronization  of  the  phases  corre¬ 
sponds  to  a  parallel  formation  where  all  particles  move  in 
the  same  direction,  which  occurs  when  |/7e|  =  1.  In  contrast, 
balancing  of  the  phases  corresponds  to  collective  motion 
around  a  fixed  point,  which  occurs  when  \pq  \  =  0.  In  [10],  a 
gradient  based  control  law  Uk  is  designed  by  optimizing  the 
potential  function  U{G),  given  by 

U{G)  =  {N/2)\pe\^  (3) 

which  is  maximized  by  synchronized  phase  arrangements 

and  minimized  by  balanced  phase  arrangements  of  a  group 
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of  moving  particles.  Most  of  the  previous  work  uses  the  same 
controller  gain  K  for  all  the  particles,  whereas  we  generalize 
the  system  by  using  different  coupling  gains  for  different 
particles.  The  gradient  control  law  is  hence  given  as, 

Uk  =  -Kugr2^dU  =  -Kk{dU/ddk),  k=l,...,N  (4) 

Eq.  (4)  can  be  simplified  as 

N 

Uk  =  -{Kk/N)Y^^m{dj-ek)  (5) 

./=i 

This  control  law  controls  the  phases  of  the  particles  and 
defines  a  phase  model  as 

9k  =  (Oo  +  Uk  (6) 


where,  cOo  is  the  initial  angular  velocity  of  each  particle. 
Eq.  (5)  is  known  as  the  Kuramoto  model  and  widely  studied 
in  the  literature  [19]-[21].  The  following  theorem  ensures 
the  asymptotic  stability  of  the  synchronized  and  the  balanced 
formations  for  heterogeneous  controller  gains  Kk  for  all  k  = 

Theorem  1:  Eor  the  gradient  control  law  (4),  all  the  solu¬ 
tions  of  the  phase  model  (6),  converge  to  the  critical  set  of 
U{9),  which  is  the  set  of  all  points  where  the  gradient  of 

N 

U (9)  is  zero.  If  ^  KkTk  <  0,  then  all  the  synchronized  phase 
k=\ 


N 

arrangements  are  asymptotically  stable  and  if  ^  KkTk  >  0, 

k=l 

then  the  balanced  phase  arrangements  are  asymptotically 

(n  Y 

stable,  where  Tk=  <  L  sin  (6^  —  0^.)  >  .  Moreover,  the  gains 

./=i 


Kk,  provide  a  sufficient  condition  for  the  synchronized  (when 
Kk  <  0,VA:)  and  balanced  (when  Kk  >  0,Vk)  phase  arrange¬ 
ments. 

Proof:  The  time  derivative  of  the  potential  function  U{9) 
is  given  as 


U{9) 


N 


E 


(7) 


Using  Eqs.  (4),  (5)  and  (6),  U{9)  becomes 


then  it  implies  that  the  potential  function  U{9)  approaches 
its  least  value  when  all  the  gain  parameters  are  positive.  The 
minimum  value  of  U{9)  occurs  at  \pg\=0.  The  condition 

(9)  indicates  the  situation  when  the  average  position  of  all 
the  particles  is  fixed,  that  is,  the  particles  form  a  balanced 
state.  Similarly,  for  all  k= 

N 

Y^KkTk<0^U{9)>0  (10) 

k=\ 

implies  that  the  potential  function  U{9)  approaches  its 
peak  value,  when  all  the  gain  parameters  are  negative.  The 
maximum  value  of  U{9)  occurs  at  \pg  \  =  1.  The  condition 

(10)  indicates  the  situation  when  all  the  particles  show  a 
synchronized  behavior  in  which  all  the  particles  have  the 
same  velocity  direction  at  any  instant  of  time.  Note  that 

Tk>9,  k=\,...,N. 

and  equality  holds  for  the  trivial  solution  when  all  the 
particles  are  already  in  the  critical  set  [2].  Therefore,  for 
nontrivial  solutions  (Tjt  >  0),  Kk  <  0  or  Kk  >  0,  for  all 
k=  is,  respectively,  a  sufficient  condition  for  the 

synchronized  and  the  balanced  phase  arrangements.  This 
completes  the  proof.  ■ 

Corollary  1:  The  desired  phase  arrangements,  for  a  spe¬ 
cial  two  particle  case  when  N  =  2,  are  realizable  for  com¬ 
bined  positive  and  negative  values  of  the  gains  Kk- 

Proof  :  This  extra  condition  on  the  controller  gain  parame- 


ters  can  be  derived  from  the  following  expressions  for  N 
written  by  using  (5),  (6)  and  (8)  as  (for  i=  1,2) 

=  2, 

K'  ^ 

Si  =  fflo  -  E 

(11) 

U(0)  =  -  ^  (Tfi  +  7^2)  [sin^  (02  -  01 )] 

(12) 

So, 

Ki+K2>0  U{9)<0 

(13) 

and 

Ki+K2<0  U{9)>0 

(14) 

U{9)  = 


1  ^ 

-^LKkTk 


k=l 


(8) 


In  the  above  equation,  there  is  no  term  containing  coq.  It 
is  because  of  the  orthogonal  property  of  the  gradt/  vector 


ly  e: 

du 


.  It  means 


d9i 


and 


with  the  vector  1,  where  1  =  (1  1  . 

that  (grade/,  1)  =  0,  where,  gradt/  = 

(x,  y)  =  x^y,  represents  the  inner  product  of  real  vectors  x 
and  y.  Eq.  (8)  shows  that  the  potential  function  U{9)  is  a 
monotonically  increasing  or  decreasing  function  according  to 


w 


the  sign  of  the  term  Y.  KkTk-  Hence,  if  for  all  k=  I,.  ..,N, 
k=\ 


N 


Y,KkTk>0^U{9)<9 

k=\ 


(9) 


It  is  clear  that  both  positive  and  negative  values  of  the 
gains  Ki  and  K2  can  together  satisfy  the  conditions  (13)  and 
(14).  ■ 


III.  Balanced  Eormation 


Balanced  formation  corresponds  to  the  motion  of  particles 
around  a  fixed  point,  which  is  the  average  position  (centroid) 
of  the  group,  and  occurs  when  the  average  linear  momentum 
{pe)  of  the  group  is  zero.  The  average  position  of  the  particle 
group  is  given  by 


R  A  Lyrk=^R=-yrk  =  -T 
^  AJ  ^  AT  ^ 


k=\ 


N 


k=l 


N 


(15) 


k=\ 


Therefore,  the  average  linear  momentum  (pg)  is  the  velocity 
R  of  the  average  position  point.  In  the  literature,  R  is  referred 
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to  as  the  order  parameter  [18],  and  balanced  formation  can 
be  achieved  when 

N  N 

R  =  0  ^  ^  cos  0/t  =  0  and  ^  sin  0*.  =  0  (16) 

k=l  k=l 

Theorem  2:  Balanced  formation  of  two  and  three  particles 
(N  =  2  or  3)  with  phase  model  (6),  respectively,  occurs  iff 

their  final  velocity  directions  after  stabilization,  are  at  angular 
2% 

separations  of  K  and  —  radians.  Moreover,  the  hnal  velocity 
direction  of  one  of  the  particles,  is  given  by 


0/  =  toot  +  52  F 


2{i-l)n 


Proof-.  For  the  special  case  when  N  =  2,  let  the  final 
velocity  directions  of  the  particles,  stabilized  to  balanced 
formation,  be  related  as 


Gif  =  Gif  -o^Bf  (say)  (18) 

where,  <7  €  [0,  2k)  is  the  angular  separation  between  the  par¬ 
ticles.  After  stabilization  to  balanced  formation,  the  angular 
rates  9i  of  their  motions  should  have  settled  down  to  cOq. 
Substituting  (18)  into  (6),  we  conclude  that  a  —  K.  This 
result  can  also  be  verified  from  (16).  Likewise,  let,  for  the 
case  when  N  =  3,  the  hnal  velocity  directions  of  the  particles, 
stabilized  to  balanced  formation,  be  related  as 


01  =  Of,  02  =  0/  +  V^i ,  03  =  0/  +  W2  (19) 

Here,  V^i ,  VL  G  [0,  2k)  and  are  the  angular  separations 
between  the  hnal  velocity  directions  of  particles  1  and  2, 
and  1  and  3,  respectively.  From  (16),  (19), 

cos  (0/ +  i/Ti )+ cos  (0/-  + 1/^2)  =  —cos  Of  (20) 

sin  (0/- +  i/Ti)  +  sin  (0/-  + 1/^2)  =  —  sin0/'  (21) 

Squaring  and  adding  (20)  and  (21),  we  get  cos(i//2  —  = 

—  1/2,  which  implies  that  VL  ~  V^i  =  2nK  +  2k f3,yn  G  Z. 

We  also  get  the  following  expressions  by  using  (6),  which 
follows  from  the  fact  that  the  angular  rates  of  the  particles 
motions  are  ft>o  when  they  stabilize  to  a  balanced  formation. 

sin  y/i  +  sin  1//2  =  0 ') 

-sinv/i -|-sin()//2  -  V^l)  =  0  >  (22) 

-  sin  y/2  +  sin  (v/i  -y/2)  =  oj 

Putting  Y2  —  Wi  =  2n7r  +  2k/ 3  in  (22),  we  get  Yi  = 
2Mi;r  +  2;r/3  and  xj/i  =  2n2KP\K/3,\ln\,ni  G  Z.  To  satisfy 
V^i,  V^2  G  [0,2;r),  we  choose  ni  =  ^2  =  0  to  get  xj/i  =  2k/3 
and  \j/2  =  4k /3.  These  results  show  that  the  hnal  velocity 
directions  of  the  particles  (for  N  =  3)  are  at  2k/ 3  radians 
angular  separations.  It  is  straightforward  to  prove  the  suffi¬ 
ciency  condition  and  hence  this  proof  is  omitted.  Now,  the 
hnal  velocity  direction  Of  can  be  found  easily.  From  (5)  and 
(6),  we  conclude  that 

E|=Ef  (23) 

Here,  0,o  is  the  initial  velocity  direction  of  the  /-th  par¬ 
ticle.  Substituting  (18)  and  (19)  (with  dehned  values  of 


(7,  and  Xj/i),  respectively,  into  (23),  the  hnal  veloc¬ 
ity  direction  Of,  for  N  =  2,3,  is  obtained  as  specihed  in 
(17).  Here,  t  is  the  simulation  time.  This  completes  the 
proof.  ■ 

For  the  two  particle  case  {N  =  2),  one  can  also  obtain 
explicit  expressions  for  the  velocity  directions  as  a  function 
of  time.  From  Eqs.  (5),  (6)  and  (23)  one  can  form  a 
differential  equation  in  terms  of  0i  as 

01  +  ^sin(^f2Co  +  o:(fih^- 61))  -  =  0  (24) 

which  can  be  solved  easily  by  the  method  of  separation  of 
variables  to  yield 

01  =  OJof +  (1/0:)  ^12^0  — 2arctan|(l/(/)e^'^')|  (25) 

Gi  =  (OQt  +  [I / fi)  A'ico  +  2arctan|(l/(/)e^'^')|  (26) 

where,  cq  =  ((0io/^i)  +  {G20/K2)),  a  =  {Ki  +K2)  /Ki,  j3  = 
{Ki  +K2)  /Ki,  A  =  {Ky  ^Ki)  /2  and  ^  =  cot(02o  -  0io)  /2 
are  constants. 

These  results  show  how  heterogeneous  controller  gains 
affect  the  particle’s  velocity  directions.  It  is  clear  form 
(25)  and  (26)  that  for  a  large  time  t,  the  velocity  direc¬ 
tions  stabilize  to  constant  values.  So,  in  the  steady-state, 
01  =  ft)ot  +  (l/a)  [K2Cq±k\  and  02  =  cffit  +  (l/j3)  [/rico±;r]. 
These  results  imply  that  |0i  —  02|  =  TT.  Hence,  the  difference 
between  the  hnal  velocity  directions  is  K,  as  desired. 

IV.  Convergence  Point  eor  N  =  2 

The  centroid  of  the  particle  group  is  stabilized  to  a  hxed 
point  when  the  particles  form  a  balanced  formation.  This 
hxed  point  is  named  as  the  convergence  point  of  the  system. 
This  convergence  point  can  be  adjusted  by  the  heterogeneous 
controller  gains  Kj^.  The  rate  of  change  of  the  convergence 
point  can  be  written  from  (15)  as 

R  =  Xc  +  iyc  =  ]-Y^e^^’^  (27) 

k=\ 

where,  Xc  and  jc  are  the  abscissa  and  the  ordinate  of  the 
point  of  convergence. 

Lemma  1:  The  convergence  point,  for  N  =  2,  approaches 
the  initial  centroid  for  large  positive  value  of  K1+K2,  where 
Ki  and  Ki  are  heterogeneous  coupling  gains  of  two  particles. 
Proof:  For  two  particles  (N  =  2),  we  can  write 

ic  =  2  Gi  +  cos  02] ;  je  =  -  [sin  0i  +  sin  02]  (28) 

Integrating  (28),  we  get 

Xc(t)  —XcO  =  (i-/2)  /  {cos  01 -I- cos  02} r/T 

Jo  (29) 

yc{t)-yco  =  (1/2)  {sin0i -f  sin02}t/T 

Jo 

where,  (vco,yco)  are  the  co-ordinates  of  the  initial  centroid. 
We  can  easily  compute  the  above  integrals.  By  using  (25) 
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Fig.  1 .  Locus  of  the  convergence  point  for  constant  p 


and  (26),  we  can  write 

JCc(r) --«e0  =  ^  dr  (30) 

Je(0  -JcO  =  (^e^^^'sin©)/ 1  (31) 

where,  0(t)  =  [coqT  +  5  —  (/)oarctan  (l/0e^'''^)] , 

^={i-})  =  (Iri)  and  constant  5  =  (^  +  ^).  A 
simple  observation  can  be  made  from  the  above  equations 
that,  for  large  positive  value  of  Ki  +  K2,  the  first  term 
(within  the  integral)  in  the  above  equations  will  tend  to 
zero.  Hence,  Xc  ^Xco  and  yc  ~ye0-  ® 

We  define  a  parameter  {K\/K2)  =  p.  For  balanced  forma¬ 
tion,  as  stated  in  (13),  and  K2  will  satisfy  the  inequality 
K\+K2>  0,  which  implies  that  T]p(p  +  1)>  0  where  Ki  =7] 
and  K2  =  {rj/p).  For  fflo  =  0,  Fig.  1  shows  the  locus  of  the 
convergence  points  for  different  value  of  p  while  keeping 
the  ratio  p  constant.  The  locus  is  a  straight  line,  as  will  be 
proved  in  Theorem  3.  Here,  two  convergence  points  {xd  ,yei) 
and  (xc2,ye2)  are  shown  corresponding  to  the  gains  rji  and 
ri2,  respectively.  Point  (xeo,yco)  is  the  initial  centroid. 

Theorem  3:  For  the  special  two  particle  case  when  N  =  2 
and  (Uo  =  0,  the  locus  of  the  convergence  points  with  different 
p  but  fixed  p,  is  a  straight  line  converging  to  the  initial 
centroid  for  higher  values  of  |  p  | . 

Proof'.  For  ft»o  =  0,  Eqs.  (30)  and  (31)  further  simplify  to 
the  following  equations: 

Xc{t)-Xco  =  {1/2X)  /cos  (32) 

yc{t)-yco  =  {1/2X)  j\os  ^5-  ^^/cos  (33) 

where,  l[  =  2arctan((l/0))  and  Zj  =  2arctan|(l/(/)e^'^')} 
are,  respectively,  the  lower  and  upper  limits  of  the  integrals. 
We  also  note  that  the  integrals  in  (32)  and  (33),  which  can  be 
denoted  as  f  and  I2,  respectively,  converge  to  some  constant 
values  when  t  ^  For  example, 

Xc{t^°°)  =XcO  +  /iiln|((/)-l)  +  \/l  +  (()2  (34) 


and 

ycit^°°)=yc0  +  h2\n  {(j)-l)  +  ^/\3^  (35) 

which  are  constant  (as  (f)  is  constant)  and  occur  when  0o  = 
0  (that  is,  Ki  —  K2  =  k).  Here,  hi  =  {cos5/k)  and  h2  = 
(sinS/tc).  The  constants  5  and  (j)Q  depend  only  on  the  gain 
ratio  p  as  5  =  ^  ^lo+pSio  ^  =  / 1-1  ^  ^  which  ensures 

that  the  integrals  f  and  f  will  individually  converge  to  the 
same  values  for  different  gains  Ki{~  pi)  and  K2{=  7]/p) 
with  fixed  p.  Therefore,  for  different  gains  pi  and  p2,  (32) 
and  (33)  can  be  obtained  for  the  case  when  as  f  ^  00  as: 

For  A)  =  pp  (  =  1,2 

Xci{t^^)-Xc0  =  pCl/p,(p  +  l) 
yci{t  ^^)-yco  =  -pC2/pi(p  +  l) 

where,  Ci  and  C2  are  constants.  Here,  the  ratio 

yci{t  °°)  -yco/xci{t  °°)  -Xco  =  -C2/C1,  /  =  1,2.  (36) 

implies  that  the  locus  of  the  convergence  points  is  a  straight 
line  with  slope  —  (C2/C1).  Also,  it  is  obvious  that  the  higher 
values  of  |p|  ensures  large  positive  values  of  Ki  +  K2. 
Therefore,  the  locus  of  the  convergence  points  approaches 
the  initial  centroid  (xco,yeo)  for  higher  values  of  |p|  (  from 
Lemma  1).  ■ 

Corollary  2:  In  Fig.  1,  Let  di  and  c?2  be  the  respective 
distances  of  points  (xcpyd)  and  {xc2,yc2)  from  the  initial 
centroid  (xeo,yco),  then  the  relation  among  the  parameters 
Pi,  P2,  di  and  d2,  is  given  by 

dirii=d2ri2  (37) 

Proof'.  With  reference  to  Lig.  1,  we  can  write 


Lrom  above  equation,  we  can  conclude  that  diPi  =  <72P2-  ® 

V.  Synchronized  Lormation 

The  particles  are  said  to  be  in  synchronized  formation 
when  the  direction  of  their  movement,  along  with  that  of 
their  centroid,  approaches  a  common  velocity  direction  Qc. 
In  synchronized  formation,  the  average  linear  momentum  of 
the  group  is  maximum,  that  is  \pq\  =  \,  which  occurs  when 
controller  gains  Kk  <0  for  all  k=  l,...,N. 

After  synchronization, 

0i(f)  =  02(O---  =  0yv(O  =  0c  (38) 

So,  from  (23),  and  (38),  we  get 

N  /  N 

0,(0  =  0X7t  +  Y,m0)/Ki)  /Y^il/Ki)  (39) 

Therefore,  we  can  get  a  desired  common  direction  0,  by  an 
appropriate  selection  of  the  gains  Kj^. 
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VI.  Simulation  Results 


Simulation  results  are  presented  for  both  balanced  and 
synchronized  configurations.  At  first,  we  discuss  the  sim¬ 
ulation  results  in  the  balanced  configuration  by  consider¬ 
ing  the  case  of  two  particles  with  their  initial  positions 
Zo  =  [(—2, 15),  (6, —5)]  and  initial  velocity  directions  Dq  = 
[30°,60°],  respectively.  Therefore,  their  initial  centroid  is 
Co  =  (2,5).  The  trajectories  of  the  particles  are  shown  in 
Fig.  2  for  the  two  sets  of  gains.  In  Figs.  2{a)  and  2{b),  the 
trajectories  are  shown  for  the  gains  K'  =  \Ki  ,K2]  =  [0.5,2] 
and  K"  =  [Ki" ,K2"]  =  [2, —0.4]  when  mo  =  0,  which  results 
in  the  convergence  points  C’j^^  =  (2.7330,6.4048)  and  C"^.  = 
(4.1392,5.0780)  with  the  corresponding  final  velocity  direc¬ 
tions  =  (0°,180°)  and  =  (-157.5°, 22.5°),  respec¬ 
tively.  Figs.  2(c)  and  2{d)  show  trajectories  for  similar  gains 
K'  and  K"  when  mo  =  0.1,  which  results  in  the  convergence 
points  C}^  =  (2.5624,6.4406)  and  C%  =  (4.2520,5.4560) 
with  the  corresponding  instantaneous  velocity  directions 
=  (344.844°,  164.844°)  and  =  (187.344°, 7.344°). 
In  all  the  figures,  the  symbol  represents  the  final  centroid 
of  the  particles. 

Consider  a  new  pair  of  gains  K  =  [^1,1^2]  =  [1,4],  which 
has  the  same  gain  ratio  p  =  {K\/K2)  =  {K\' /K2)  =  0.25 
as  K' .  For  K,  we  have  the  convergence  point  Cfs  = 
(2.3690,5.7040)  when  mo  =  0.  With  reference  to  Fig.  1,  we 
get  the  distances  di  —  1.58  (which  is  the  distance  between 
C'fs  and  Co)  when  rji  =  0.5  and  d2  =  0.79  (which  is  the 
distance  between  C/^  and  Cq)  when  TJ2  =  1.  Hence,  we  can 
easily  verify  that  dirji  =  d2'ri2  =  0.79,  as  proved  in  (37). 

The  simulation  results  in  synchronized  config¬ 
uration  are  shown  in  Fig.  3,  where  we  consider 
six  particles  with  their  initial  positions  zo  = 
[(0,0),  (-2, 15),  (-1,1),  (6, -5),  (8,0),  (0,4)]  and  initial 
velocity  directions  do  =  [15°, 30°, 45°, 60°, 70°,  120°], 
respectively.  In  Figs.  3(a)  and  3{b),  the  trajectories  of 
the  particles  along  with  their  centroid  are,  respectively, 
shown  for  the  gains  G'  =  [—1,— 3,— 5,— 7,— 9,  — 11]  and 
G"  =  [-1, -1/3, -1/5, -1/7, -1/9, -1/11]  when  mo  =  0, 
which  correspondingly  result  in  common  directions  of 
motion  at  an  angles  d'j^^  =  42.5031°  and  d'jr^  =  69.1667°. 
Similarly,  we  get  the  hnal  common  directions  as 
d'^^  =  256.032°  and  d"^  =  282.708°,  corresponding  to 
the  gains  G'  and  G"  when  mo  =  0. 1 . 

VII.  Conclusions 

This  paper  analyses  a  special  kind  of  cooperative  control 
framework  for  heterogeneously  coupled  particles.  The  proper 
selection  of  these  heterogenous  controller  gains  has  a  signif¬ 
icant  effect  on  the  formation  of  balanced  and  synchronized 
configurations  of  the  particles.  In  the  balanced  conhguration, 
we  can  control  both  the  velocity  directions  as  well  as  the 
convergence  point  while  in  the  synchronized  conhguration, 
we  can  get  a  desired  common  direction  of  motion  by  se¬ 
lecting  heterogeneous  gains  appropriately.  Some  interesting 
results  are  shown  for  two  particles  in  balanced  conhguration 
(when  mo  =  0)  as  the  locus  of  the  convergence  points  for 
the  varying  gains  is  a  straight  line  converging  to  the  initial 


(c)  For  K'  =  [0.5,2]  and  tBo  =  O.I 


(d)  For  K"  =  [2, -0.4]  and  (Oq  =  O.I 


Fig.  2.  Balanced  trajectories  of  the  two  particles  along  with  their 
convergence  point  for  different  gain  pairs 
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(a)  For  G'-  [-1,-3, -5, -7, -9, -11]  and  (Oq^O 


(b)  For  G"  ^  [-l,-5,-5,- and  cqq  ^  0 
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(c)  For  G'-[-l,-3,-5,-7,-9,-ll]  and  fno-0.1 
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(d)  For  G"  =  and  cua  =  0.1 

Fig.  3.  Synchronized  trajectories  of  the  six  particles  along  with  their 
centroid  for  different  gain  pairs 
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centroid.  These  properties,  related  to  the  heterogenous  gains, 
have  a  wide  range  of  applications  in  controlling  aerial  and 
underwater  vehicles. 
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Abstract:  In  this  paper,  we  study  the  collective  motion  of  a  group  of  2)  identical  agents 
trying  to  achieve  a  circular  formation  centered  at  a  desired  location,  which  is  fixed.  A  circular 
formation  is  characterized  by  the  motion  of  all  agents  around  the  same  circle  in  the  same 
direction.  To  solve  this  problem,  we  propose  a  planar  motion  model  that  incorporates  two 
control  inputs.  One  of  the  control  inputs  is  chosen  independently  and  the  other  control  input 
is  decided  by  using  the  composite  Lyapunov  function.  We  show  that  the  desired  location  of  the 
center  of  this  circular  formation,  which  is  fixed,  is  obtained  by  directing  the  centroid  of  the 
group  of  agents  to  that  desired  location.  This  leads  to  a  collective  formation  of  all  the  agents, 
known  as  balanced  circular  formation.  The  theoretical  findings  are  supported  by  simulations. 

Keywords:  Multiagent  system,  balanced  formation,  circular  formation. 


1.  INTRODUCTION 


Collective  control  of  multiagent  systems  has  received  con¬ 
siderable  attention  among  control  engineers  to  address  the 
challenges  related  to  formation  of  aerial  and  underwater 
vehicles.  Depending  upon  the  nature  of  a  wide  range  of 
applications  such  as  tracking,  surveillance,  reconnaissance, 
search  and  data  collection  (Casbeer  et  al.  (2006);  Leonard 
et  al.  (2007);  Paley  (2007a)),  there  is  a  need  for  achieving 
various  formations  of  these  vehicles.  In  this  paper,  a  spe¬ 
cific  kind  of  collective  formation,  in  which  all  the  agents  of 
a  group  move  on  a  common  circle  in  such  a  way  that  their 
centroid  (average  position  of  all  the  agents)  and  the  center 
of  the  common  circle  traversed  by  them  are  the  same,  and 
remains  fixed  on  a  desired  location,  is  considered.  This 
kind  of  formation  of  agents  is  called  a  balanced  circular 
formation  about  the  desired  center  (or  centroid) .  The  word 
“balanced”  refers  to  the  motion  of  all  the  agents  such  that 
their  movement  gives  rise  to  a  fixed  centroid. 

Sepulchre  et  al.  (2007)  proposed  a  steering  control  law  to 
stabilize  synchronized  and  balanced  circular  formations  of 
a  group  of  agents.  Synchronization  refers  to  the  situation 
where  all  the  agents,  along  with  that  of  their  centroid, 
move  in  the  same  direction.  These  formations,  as  described 
in  Sepulchre  et  al.  (2007),  are  shown  to  be  stabilized  to 
a  common  circle  centered  at  an  arbitrary  and  desired 
locations.  Contrary  to  their  analysis,  in  this  paper,  by 
using  a  modified  planar  motion  model  of  the  agent,  the 
possibility  of  getting  a  desired  center,  only  in  the  case 
of  balanced  circular  formation,  is  explored.  In  our  earlier 
work  Jain  et  al.  (2014)  (unpublished),  the  stabilization 
of  collective  formation  of  a  group  of  A-agents,  where 
each  agent  either  moves  in  a  straight  line  or  rotates  on 


individual  circle,  in  a  manner  that  their  centroid  remains 
fixed  at  the  desired  location,  is  discussed.  As  an  extension, 
in  this  paper,  the  control  laws  are  proposed  to  get  a 
balanced  circular  formation,  where  all  the  agents  orbit 
a  common  circle  centered  at  a  desired  location,  which  is 
fixed. 

Recently,  a  various  control  strategies  are  proposed  to 
obtain  different  structures  of  circular  formations  of  a  group 
of  autonomous  agents.  Paley  et  al.  (2005)  derived  a  control 
law  to  stabilize  the  splay  state  formation  in  which  the 
agents  spread  out  equidistantly  on  a  circle.  Xu  et  al. 
(2013)  provided  similar  results  by  utilizing  a  modified 
Kuramoto  model  (Strogatz  (2000)).  Paley  (2008)  proposed 
a  Lyapunov-based  design  methodology  to  stabilize  the 
collective  circular  motion  of  the  agents  in  a  known  uniform 
and  constant  flow  field.  A  further  extension  to  this  problem 
is  given  by  Paley  and  Peterson  (2009),  where  the  flow-field 
is  time-invariant  but  assumed  to  vary  in  space.  To  attain 
the  parallel  and  circular  formations  of  the  agents,  the 
backstepping  approach  of  designing  the  control  algorithms 
is  discussed  by  Mellish  and  Paley  (2010).  An  interesting 
related  work  on  achieving  collective  circular  motion  is 
given  in  Chen  and  Zhang  (2011,  2013),  where  the  authors 
consider  a  heterogeneous  model  for  the  agents  in  the  sense 
of  their  linear  and  rotational  speeds. 

The  main  contribution  of  this  paper  is  to  propose  a 
strategy  to  stabilize  the  balanced  circular  formation  of 
a  group  of  identical  multiagent  system  about  a  desired 
location  of  the  center.  We  show  that  the  agents,  which 
start  from  arbitrary  initial  positions  and  with  arbitrary 
initial  velocity  directions,  stabilize  to  a  circular  formation 
in  such  a  way  that  the  center  of  the  common  circle  and 
the  centroid  of  the  group,  both  converge  to  a  common 
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Fig.  1.  Orientation  of  the  k-th  agent  in  the  2D  plane  for 
dynamics  (la)  and  (lb). 


Fig.  2.  fc-th  agent  rotating  on  a  circle  in  the  2D  plane 

desired  point.  For  this  purpose,  we  use  the  tools  from  the 
Lyapunov  theory  and  the  LaSalle’s  Invariance  principle 
(Khalil  (2000))  to  prove  the  stability  of  the  collective 
motion  of  A^-agents. 

The  rest  of  the  paper  is  organized  as  follows.  In  Section 
II,  we  state  a  few  definitions  and  describe  the  system 
dynamics.  In  Section  III,  the  feedback  control  laws  are 
proposed  to  achieve  the  desired  formation  of  the  agents. 
In  Section  IV,  Lyapunov  based  approach  is  provided  to 
assure  the  stability  of  the  desired  collective  formation.  The 
simulation  results  are  discussed  in  Section  V. 

2.  SYSTEM  DESCRIPTION  AND  PROBLEM 
FORMULATION 

Previous  work  in  this  area  has  focused  on  the  collective 
dynamics  of  N  autonomous  agents  in  which  each  agent 
(assumed  to  have  unit  mass)  moves  at  unit  speed  in  a 
planar  space.  The  equations  of  the  motion  of  the  fc-th  agent 
are  (Paley  et  al.  (2007b)): 

f-fc  =  e*®*"  (la) 

4  =  Ufc,  k=l,...,N  (lb) 

Here,  the  position  of  the  k-th  agent  is  r^,  while  its  velocity 
is  Vk  =  e*®*,  where  i  =  is  the  standard  complex 

number  and  9k  denotes  the  orientation  of  the  velocity 


vector  from  the  positive  x-axis.  In  Paley  et  al.  (2007b), 
the  direction,  9k  of  the  velocity  vector  of  fc-th  agent  is 
also  referred  to  as  its  phase.  The  turn  rate,  9k  of  the  fc-th 
agent  is  determined  by  the  steering  control  law  Uk-  The 
interpretation  of  (la)  and  (lb)  is  given  in  Fig.  1. 

It  is  worth  noting  that,  if,  for  all  fc  =  1 ...  77,  the  control 
input  Uk  is  identically  zero,  then  each  agent  travels  in  a 
straight  line  in  its  initial  direction  0^(0).  If  the  control 
input  Uk  =  ujq  is  constant  and  non  zero,  then  each  agent 
rotates  on  a  circle  with  radius  po  =  This  situation 

is  shown  in  Fig.  2,  where  the  center  of  the  circle  traversed 
by  the  fc-th  agent  is  Ck  ■  The  multiplication  of  the  complex 
number  i  to  the  velocity  vector  e*®''  provides  a  vector  , 
which  is  in  the  direction  perpendicular  to  the  velocity 
vector  e*®''  and  points  towards  the  center  Ck  (as  shown 
in  Fig.  2).  Therefore,  by  using  the  law  of  vector  addition, 
the  center  of  the  circle  traversed  by  the  A:-th  agent  is, 

Cfc  =  rfe  +  (2) 

Now,  we  state  the  following  definitions  from  the  previous 
literature  (Sepulchre  et  al.  (2007)). 

Definition  1 :  Let  Ck  be  given  by  (2),  c  =  (ci, . . . ,  cat)^  G 
C^,  0  ^  {9,,...,9nV,  1  4  (l,...,l)r  e  Co  e  C, 
uiQ  G  K,  and  wq  yf  0.  A  circular  formation  of  the  agent’s 
model  defined  in  (la)  and  (lb)  is  the  set  of  trajectories  for 
which  9  =  wqI  and  c  =  cqI,  that  is,  all  the  agents  travel 
around  a  circle  of  radius  |wo|~^  and  the  centers  of  all  the 
circles  coincide  to  a  common  point  cq.  The  direction  of 
rotation  is  determined  by  the  sign  of  tuo-  If  wq  >  0,  then 
all  the  agents  rotate  in  the  counterclockwise  direction. 
Whereas,  if  ujq  <  0,  then  all  the  agents  rotate  in  the 
clockwise  direction.  The  relative  phases  of  the  agents  in 
a  circular  formation  are  arbitrary. 

Definition  2\  A  balanced  circular  formation  of  the 
agent’s  model  defined  in  (la)  and  (lb)  is  a  circular  for¬ 
mation  of  all  the  agents  such  that  their  motion  along 
the  common  circle  posseses  a  fixed  centroid  Cq,  that  is, 
the  locations  of  the  center  of  the  common  circle  and  the 
centroid  of  the  group  coincide  at  a  point  cq  and  remain 
stationary. 

In  order  to  reach  the  objective  of  this  paper,  a  modified 
agent’s  model  is  proposed  as  (Jain  et  al.  (2014)) 

fk  =  e*®''  -k  uq  =  (3a) 

9k  =  Uk,  k=l,...,N  (3b) 

Here,  uq  G  C  is  an  explicitly  appended  control  input,  which 
assumes  the  same  values  for  all  the  agents  and  controls 
both  the  magnitude  and  the  direction  of  the  resultant 
velocity  vector  of  each  agent.  Later  we  discuss  in  the  next 
section  how  to  choose  mq  to  get  a  desired  behavior  of  the 
velocity  vector  of  each  agent.  The  velocity  of  the  A:-th  agent 
is  Ufc  =  I  e*®''  +  uo  1 1  while  the  heading  angle  of  the  fc-th 
agent  is  if^k-  The  other  parameters  are  similarly  defined  as 
in  (la)  and  (lb).  The  interpretation  of  (3a)  and  (3b)  is 
shown  in  Fig. 3. 

3.  DESIGN  OF  CONTROL  LAWS 

The  problem  addressed  in  this  paper  is  solved  in  three 
steps.  At  first,  a  Lyapunov  based  potential  function  is 
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described  whose  minimization  leads  to  the  circular  for¬ 
mation.  Later,  the  convergence  of  the  current  centroid  of 
the  group  to  a  desired  location  cq  is  shown  by  minimizing 
another  potential  function  which  incorporates  the  selection 
of  the  control  input  uq.  Finally,  the  control  law  Uk  is 
proposed  by  minimizing  the  composite  Lyapunov  function 
consisting  of  these  potential  functions. 

3. 1  Achieving  Circular  Formation 

A  circular  formation  is  obtained  when  all  the  centers  of 
the  circles  traversed  by  each  agent  coincide.  This  cor¬ 
responds  to  the  following  algebraic  condition  (Sepulchre 
et  al.  (2007)) 

Pc=0;  P  =  /^-^ll^.  (4) 

Here,  P  is  a  symmetric  projection  matrix  and  satisfies 
P  =  P^  and  P^  =  P.  The  matrix  P  has  only  two  distinct 
eigenvalues:  zero,  which  has  multiplicity  one,  and  one, 
which  has  multiplicity  —  1.  Therefore,  Pc  =  0  if  and 
only  if  c  =  cqI.  For  ease  of  calculation,  we  multiply  Ck  by 
a  constant  factor  — iwo  to  get  a  new  variable 

Sfc  =  -iuoCk  =  6*®'=  -  iiOoVk-  (5) 

Therefore,  in  order  to  achieve  the  circular  formation  the 
condition  (4)  can  be  equivalently  stated  as 

Ps  =  0;  P  =  In-  ^11^.  (6) 

This  suggest  the  minimization  of  the  following  candidate 
Lyapunov  function  (Sepulchre  et  al.  (2007)) 

S{r,0)  =  ^\\Ps\\^  =  ^{Ps,Psf  (7) 

Here,  (^1,22)  =  Re{ziZ2}j  represents  the  inner  product 
of  complex  numbers  zi,Z2  S  C,  where  zi  denotes  the 
complex  conjugate  of  zi.  Analogously,  for  vectors,  the 
boldface  notation  (zi,^2)  =  Re{ziZ2},  is  used.  The  bold¬ 
face  parameters  s  and  r,  respectively,  denote  the  7V-vector 
s  =  (si, . . . ,  sat)^  and  r  =  (ri, . . . ,  r^)'^ .  Note  that  the 
potential  S{r,6)  is  a  positive  semi-definite  function  and 
approaches  zero  when  Ps  =  0. 

By  differentiating  (5)  along  the  solutions  of  (3a)  and  (3b), 
we  get 

s/c  =  ze*®'=(ufc  -  tuo)  -  iwouo-  (8) 

Taking  the  time  derivative  of  the  Lyapunov  function  (7) 
along  the  trajectories  of  (3a)  and  (3b)  yields 

N 

S={Ps,  Ps)  =  {PkS,  )  {uk  -  Wo)  (9) 

k^l 

where,  Pk  denotes  the  k-th  row  of  the  matrix  P.  Since 

1  h  ^  ■  \ 

PkS  =  Sk  -  —  I'^s  =  e*®''  -  iuJoVk  -  ^  X! 

(10) 

we  obtain 

(PfeS,ie*®'')  =  -(wo(rfc  -P),e*®'')  -  ^ ^  ^ 

=  (11) 


Fig.  3.  Orientation  of  the  k-th  agent  in  the  2D  plane  for 
dynamics  (3a)  and  (3b). 

where  R=  Y.k=i  rk  =  rk-R  and  Pe  =  jf  ■ 

Using  (11),  (9)  can  be  rewritten  as 

N 

5=  -  ^  (cjo  +  {pe,iP^^))  {uk  -  ujq)  (12) 

k^l 

This  expression  will  be  used  in  sequel  for  further  simplifi¬ 
cations. 

3.2  Convergence  of  Croup  Centroid  to  the  Desired  Location 

Let  the  locations  of  the  current  and  the  desired  centroid 
of  a  group  of  N  agents  be  rc  and  rcd{=  cq),  respectively. 
Note  that  the  location  of  the  desired  centroid  red  is  selected 
similar  to  the  center  cq  of  the  common  circle.  It  will  be 
proved  later  that,  after  stabilization  to  balanced  circular 
formation,  the  center  cq  of  the  common  circle  is  the 
centroid  of  the  group.  This  was  the  motivation  behind  the 
idea  of  achieving  convergence  of  the  centroid  of  the  group 
to  a  desired  location  cq,  which  is  the  center  of  the  common 
circle.  From  (3a),  the  rate  of  change  of  the  position  of  the 
current  centroid  fc  is, 

fc  =  —  ^  e*®"  -k  Uo  (13) 

^  k=l 

To  ensure  consensus  between  the  positions  of  the  current 
and  the  desired  centroids,  the  concept  of  the  reference  ve¬ 
locity,  which  is  the  commanded  velocity  of  the  centroid  of 
the  group  of  agents,  is  adapted  from  Klein  and  Morgansen 
(2006).  The  reference  velocity  fref  is  defined  as 

rref  =  f{.D)u.  (14) 

where,  f{D)  is  a  smooth  function  of  the  variable  D  = 
Il'Ced  ~  ’’cll)  which  is  the  distance  between  the  current  and 

red  ~  re 

the  desired  centroid.  The  parameter  u  =  rj - |t,  is 

\\red  -  re\\ 

a  unit  vector  along  the  straight  line  joining  the  current 
and  the  desired  centroids.  The  reference  velocity  is  de¬ 
fined  in  such  a  way  that  it  must  satisfy  the  condition 
f  (D)  —  0,  when  the  locations  of  the  current  and 
the  desired  centroids  coincide  (Jain  et  al.  (2014)). 

Now,  let  the  error  between  the  velocity  of  the  collective 
centroid,  re,  and  reference  velocity,  r^e/,  be 
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ev=fc  -  fref  (15) 


Consider  a  candidate  Lyapunov  function  (Jain  et  al. 
(2014)): 


U(0)  =  y  ||e„|P  =  y  llf-c  -  f-refW^ 

(16) 

In  (13),  let 

uq  be  as 

Uq  =  fref 

(17) 

to  have 

1  ^ 

Tc  -  fref  =  =  pg 

(18) 

and  hence 

k^l 

U{0)  =  f^\\pg\? 

(19) 

The  time  derivative  of  the  Lyapunov  function  U,  along  the 
trajectories  (3a)  and  (3b),  is 


Using  (18),  we  get 

N 

^  =  X!  (21) 

k^l 

The  above  expression  can  also  be  rewritten  as 

N 

t7  =  ^(pe,ze*^'=)(ufc-wo)  (22) 

k^l 

It  is  because  of  the  property  (A,l)  =  0,  where  = 
and  A  =  (Ai, . . . ,  Aat)^. 

3.3  Composite  Lyapunov  Function  and  Control  Law  Uk 


Consider  a  composite  Lyapunov  function 
V{r,0)  =  S{r,0)  +  U{e). 


(23) 


The  time  derivative  of  the  Lyapunov  function  V,  along  the 
trajectories  (3a)  and  (3b),  is 

V  =  S  +  il  (24) 

Using  (12)  and  (22)  into  (24)  yields 

N 

V  =  -UJO  ^  {uk  -  (Vq)  (25) 


Choosing  the  control  law 

Uk  =  u)o{l  +  K  (ffc,e*^'=)) 

results  in 


N 


V  =  -KuJo'^J2(^k,e' 

k=l 

which  is  negative  semi-definite  for  all  K  >  0.  By  LaSalle’s 
Invariance  principle  (Khalil  (2000))  all  solutions  of  the 
system  defined  in  (3a)  and  (3b),  asymptotically  converge 
to  the  largest  invariant  set  M  where 

(28) 


(26) 


(27) 


(ffe,e*^'=)  =  0 


for  all  k  =  1, . . . ,  In  this  set,  the  dynamics  reduce  to 
9k  =  oJo,  which  implies  that  s  =  0  (as  the  asymptotic 
value  of  Mo  =  0).  It  means  that  Ps  =  0  and  hence  Pc  =  0. 
As  a  result,  c  =  cqI  for  some  fixed  cq  G  C,  that  is,  the 
centers  of  the  individual  circles  traversed  by  all  the  agents 
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coincide.  Moreover,  due  to  the  non-increasing  nature  of  V, 
the  potential  U  also  approaches  zero.  Hence,  the  solutions 
converge  to  a  circular  relative  equilibrium  in  the  critical 
set  of  U  where  the  asymptotic  value  of  pg  =0. 

4.  STABILITY  ANALYSIS 

In  this  section,  it  is  shown  that  the  locations  of  the  current 
and  the  desired  centroid  also  coincide  when  the  velocity  of 
the  current  centroid  matches  with  the  reference  velocity. 
Therefore,  the  current  centroid  of  the  agents  converges  to 
the  desired  point  cq. 

Consider  the  Lyapunov  function 

V{r)  =  ^\\rcd-rc\\'^-  (29) 

The  time  derivative  of  the  Lyapunov  function,  U(r),  is 
given  as 

V (r)  =  {red  -  re,  -fed  -  Vc)  (30) 

Using  fc  =  fref  and  (14),  gives 

=  -Df{D)  (31) 

Following  the  Lyapunov  stability  requirements  (Khalil 
(2000)),  it  can  be  concluded  that  the  condition  f{D)  > 
0,  VU,  implies  that  the  potential  V{r)  is  a  deceasing 
function  and  approaches  zero  when  =  red  =  cq,  as 
desired.  Therefore,  by  choosing  the  control  laws  mq  and 
Uk,  respectively,  as  in  (17)  and  (26),  balanced  circular 
formation  at  the  desired  center  cq,  is  stabilized. 

After  stabilized  to  balanced  circular  formation  centered  at 
Co,  the  centers  of  individual  circles  traversed  by  each  agent 
satisfies 

Cl  =  C2  =  .  .  .  =  Cat  =  Cq.  (32) 

By  tacking  the  average  of  (2)  on  both  the  sides  and 
using  the  fact  that,  after  stabilization  to  balanced  circular 
formation,  pg  =  Q.  We  have 

1  ^ 

^0  =  j^'^Tk  (33) 

^  k=l 

Therefore,  after  stabilization  to  balanced  circular  forma¬ 
tion,  the  center  of  the  common  circle  is  the  centroid  of  the 
group  of  agents. 

5.  SIMULATION  RESULTS 

Simulations  results  are  provided  for  N  =  20  agents  with 
random  initial  positions  and  initial  headings.  Fig.  4  shows 
the  the  trajectories  of  the  agents  along  with  their  centroid 
(shown  by  dashed  line)  for  f{D)  =  2(1  —  e“°'®^),  angular 
frequency  wq  =  0.1  and  the  controller  gain  K  =  0.1.  The 
agents  converge  to  a  common  circle,  which  is  centered 
at  the  desired  location  (10, 10)  and  has  the  radius  po  = 
|wo|~^  =  10  units.  Fig.  5  depicts  the  variation  of  function 
f(P)  with  time,  which  approaches  zero  with  time.  The 
variation  of  the  argument  9d  of  the  control  input  mq  with 
time,  is  shown  in  Fig.  6,  which  shows  that  the  agents  go 
round  the  centroid  as  they  converge  to  final  desired  circle. 

For  better  visualization  of  the  paths  traversed  by  the 
agents,  the  trajectory  of  one  of  the  agents  (say  the  fc-th 
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Fig.  4.  Balanced  circular  formation  of  =  20,  agents 
in  the  2D  plane  for  f{D)  =  2(1  —  and 

ujq  =  K  =  0.1.  The  desired  location  of  the  center 
is  at  (10, 10). 

agent,  fc  =  1)  is  shown  in  Fig.  7,  where  it  converges  to  the 
desired  circle.  Fig.  8  represents  the  variation  of  the  control 
input  Uk  of  the  k-th  agent  with  time,  which  approaches  to 
a  constant  value  Ukf  =  0.1.  It  happens  because  of  the 
fact  that,  after  stabilization,  the  control  input  Uk  must 
satisfy  Ukf  =  ujQ  =  0.1,  for  all  fc  =  1, . . . ,  TV.  Therefore,  the 
simulation  results  are  in  accordance  with  the  theoretical 
findings. 

Note  that,  in  Fig.  4,  the  agents  are  rotating  about  the 
desired  center  such  that  their  relative  positions  on  the 
common  circle  are  arbitrary.  To  get  a  balanced  circular 
formation  where  the  agents  are  equally  spaced  on  the 
common  circle,  is  an  interesting  future  work. 

According  to  the  need  of  various  practical  applications, 
it  would  be  interesting  to  extend  the  problem  addressed 
in  this  paper  to  account  for  bounded  variations  in  the 
velocity  of  agents  with  time.  The  results  of  this  paper  can 
also  be  further  generalized  to  stabilize  balanced  formations 
around  ellipsoidal  trajectories. 


Fig.  5.  Variation  of  f{D)  with  time,  where  f{D)  is  the 
magnitude  of  the  control  input  uq  =  . 


Fig.  6.  Variation  of  Od  with  time,  where  9d  is  the  argument 
of  control  input  mq  =  /(-D)e®®°. 
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Stabilization  of  Collective  Motion  in  Synchronized,  Balanced  and  Splay 
Phase  Arrangements  on  a  Desired  Circle 


Anoop  Jain^  and  Debasish  Ghose^ 


Abstract —  This  paper  proposes  a  design  methodology  to  sta¬ 
bilize  collective  circular  motion  of  a  group  of  A^-ldentical  agents 
moving  at  unit  speed  around  individual  circles  of  different  radii 
and  different  centers.  The  collective  circular  motion  studied 
in  this  paper  is  characterized  hy  the  clockwise  rotation  of  all 
agents  around  a  common  circle  of  desired  radius  as  well  as 
center,  which  is  fixed.  Our  interest  is  to  achieve  those  collective 
circular  motions  in  which  the  phases  of  the  agents  are  arranged 
either  in  synchronized,  in  balanced  or  in  splay  formation.  In 
synchronized  formation,  the  agents  and  their  centroid  move  in 
a  common  direction  while  in  balanced  formation,  the  movement 
of  the  agents  ensures  a  fixed  location  of  the  centroid.  The 
splay  state  is  a  special  case  of  balanced  formation,  in  which 
the  phases  are  separated  by  multiples  of  27t/N.  We  derive  the 
feedback  controls  and  prove  the  asymptotic  stability  of  the 
desired  collective  circular  motion  by  using  Lyapunov  theory 
and  the  LaSalle’s  Invariance  principle. 

Keywords:  Multiagent  system;  synchronization;  balanc¬ 
ing;  splay  state;  desired  common  circle. 

1.  Introduction 

Depending  upon  the  nature  of  a  wide  range  of  engineering 
applications  such  as  tracking,  surveillance,  reconnaissance, 
environmental  monitoring,  searching,  sensing  and  data  col¬ 
lection,  various  collective  motions  of  the  multiagent  system 
have  been  explored  in  the  recent  years.  The  particularly 
interesting  collective  motion  considered  in  this  paper  is  the 
collective  circular  motion,  in  which  the  agents  move  on  a 
common  circle  of  desired  radius  and  center  in  a  way  such 
that  their  headings  are  either  in  synchronized,  in  balanced, 
or  in  splay  formation.  Synchronization  refers  to  the  situation 
when,  at  all  times,  the  agents,  along  with  that  of  their 
centroid,  which  is  the  average  position  of  the  group  of  agents, 
have  a  common  velocity  direction.  A  complementary  notion 
of  synchronization  is  balancing,  in  which  the  headings  of 
the  agents  on  the  desired  common  circle,  are  arranged  in 
such  a  way  that  their  centroid  remains  fixed.  The  splay  state 
formation,  which  is  a  special  case  of  the  balanced  formation, 
refers  to  the  situation  in  which  the  headings  of  the  agents 
on  the  desired  common  circle,  are  separated  by  a  multiple  of 
2n/N,  where  N  is  the  number  of  agents.  Note  that  the  phrase 
“the  desired  common  circle”  is  an  abbreviation  of  the  phrase 
“the  common  circle  of  desired  radius  and  center,  which  is 
fixed”. 
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The  present  work  is  inspired  by  the  problem  addressed  in 

[1]  and  [2],  where  the  control  laws  are  proposed  to  stabilize 
the  collective  motion  of  a  group  of  agents  about  a  common 
circle.  In  [1],  the  splay  formation  of  a  group  of  agents  is 
stabilized  on  a  common  circle  of  prescribed  radius,  which 
is  centered  at  the  origin.  On  the  other  hand,  in  [2],  the 
synchronized  and  balanced  collective  motions  of  the  agents, 
initially  rotating  around  individual  circles  of  same  radius, 
are  stabilized  on  a  common  circle,  which  is  centered  at  the 
prescribed  location  and  have  a  radius  similar  to  that  of  initial 
individual  circles.  However,  unlike  previous  work  in  [1]  and 

[2] ,  in  this  paper,  control  laws  are  proposed  to  stabilize  the 
collective  motion  on  a  desired  common  circle  by  assuming 
that  the  agents  are  initially  rotating  around  individual  circles 
of  different  radii.  In  a  similar  context,  Napora  and  Paley  in 

[3]  describe  an  observer-based  feedback  control  algorithm 
to  stabilize  circular  formation  using  measurements  of  the 
relative  position  only.  However,  in  the  present  work,  control 
scheme  is  proposed  not  only  to  stabilize  the  collective  motion 
of  agents  around  a  desired  common  circle  but  also  to  achieve 
synchronized,  balanced  and  splay  formations  of  their  phase 
angles. 

There  exists  an  ample  literature  related  to  the  study  of  col¬ 
lective  circular  motion  of  multiagent  system.  In  [4],  control 
laws  are  proposed  to  stabilize  the  collective  circular  motion 
of  nonholonomic  vehicles  around  a  virtual  reference  beacon, 
which  is  either  stationary  or  moving.  Similar  results  are  given 
in  [5],  where  a  Lyapunov  guidance  vector  field  approach  is 
used  to  guide  a  team  of  unmanned  aircraft  to  fly  a  circular 
orbit  around  a  moving  target  with  prescribed  inter-vehicle 
angular  spacing.  In  [6],  Chen  and  Zhang  propose  a  decentral¬ 
ized  control  algorithm  for  a  group  of  nonholonomic  vehicles 
to  form  a  class  of  collective  circular  motion,  in  which  the 
vehicles  are  evenly  distributed  over  the  motion  circle,  and 
have  the  same  rotational  radius.  The  latter  assumption  is 
relaxed  in  [7],  where  the  agents  move  in  circles  around  a 
common  center,  but  with  different  radii.  Arranz  et  al.  in  [8], 
[9]  provide  the  control  algorithms  to  stabilize  the  collective 
motion  of  multiagent  systems  around  a  circular  orbit,  which 
has  either  a  fixed  radius  and  time-varying  center  [8],  or  a 
fixed  center  and  time-varying  radius  [9].  The  stabilization 
of  collective  circular  motion  in  a  uniform  and  constant 
flow-field,  is  given  in  [10],  [11].  These  results  are  further 
extended  in  [12]  for  the  time-varying  flow-field.  In  [13], 
the  splay  circular  formation  of  multiple  robots  is  stabilized 
by  using  a  modified  Kuramoto  model.  In  [14],  the  circular 
motion  of  agents  in  the  symmetric  patterns  of  their  phases, 
are  investigated  for  a  ring-like  coupled  network.  A  popular 
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collective  circular  motion  of  multivehicle  system  under  cyclic 
pursuit  is  given  in  [15]. 

The  main  contribution  of  this  paper  is  to  propose  a  control 
strategy  to  stabilize  the  collective  motion  of  a  group  of  agents 
on  a  desired  common  circle  with  their  phase  arrangements 
either  in  synchronized,  in  balanced  or  in  splay  formation, 
while  allowing  the  radii  and  centers  of  individual,  initial 
circular  motions,  performed  by  the  agents,  to  be  different. 
With  this  purpose,  in  this  paper,  we  consider  the  model 
of  identical,  all-to-all  coupled  agents  moving  in  a  plane  at 
constant,  unit  speed  and  propose  a  control  scheme  which 
incorporates  two  feedback  controllers.  The  dynamics  of  each 
agent  is  represented  by  a  state  vector,  which  includes  the 
position,  heading  and  angular  frequency  of  each  agent  as  its 
elements. 

The  paper  is  organized  as  follows.  In  Section  II,  we 
describe  the  dynamical  model  of  the  system  and  formulate 
the  problem.  In  Section  III,  we  propose  feedback  control  laws 
to  stabilize  collective  motion  of  agents  in  synchronized  and 
balanced  formations  on  a  desired  common  circle.  The  control 
laws  to  stabilize  splay  formation  of  agents  on  a  desired 
common  circle  are  proposed  in  Section  IV.  Simulation  results 
are  discussed  in  Section  V.  The  concluding  remarks  appear 
in  Section  VI. 

II.  System  Description  and  Problem  Formulation 

Consider  a  group  of  N  identical  agents  in  which  each  agent 
(assumed  to  have  unit  mass)  moves  at  unit  speed  on  a  plane. 
We  identify  plane  with  the  complex  plane  C  and  use 
complex  variables  to  describe  the  position  and  velocity  of 
each  agent.  For  k=  the  position  of  the  k-th  agent 

is  ri^  G  C,  while  the  velocity  of  k-th  agent  is  =  e'®*  G  C, 
where,  G  is  the  orientation  of  the  (unit)  velocity  vector 
of  the  k-th  agent  from  the  real  axis,  and  i  =  denotes  the 
standard  complex  number.  The  orientation,  9k  of  the  velocity 
vector  is  also  referred  to  as  the  phase  of  the  k-th  agent  [16], 
[17].  Let  Wjt  G  ffi  be  the  angular  frequency  of  the  circular 
orbit  performed  by  the  k-th  agent.  With  these  notations,  the 
dynamical  equations  of  the  motion  for  the  k-th  agent  are 


rk  =  e‘ 

(la) 

9k  =  -COk  +  Uk 

(lb) 

(Ok  =  Pk,  k=l,...,N 

(Ic) 

where,  G  M  and  G  M  are  the  feedback  control  laws, 
which  control  the  heading  and  angular  frequency  of  the  k-th 
agent,  respectively. 

If,  for  all  k=  the  control  laws  Uk  and  jj.k  are 

identically  zero,  then  each  agent  travels  at  constant,  unit 
speed  on  a  circle  of  radius  Pk=  |  |  ^ ' .  The  convention  of 

direction  of  rotation  on  the  circle  followed  in  this  paper  is, 
if,  for  all  k  =  the  angular  frequency  (Ok  >  0,  then 

all  the  agents  rotate  in  the  clockwise  direction  and  if,  for  all 
k=l,...,N,  the  angular  frequency  (Ok  <  0,  then  all  the  agents 
rotate  in  the  anticlockwise  direction.  This  convention  is  based 
on  the  observation  that  under  the  controls  Uk  =  Pk  =  0  for  all 
k  =  the  rate  of  change  of  heading  of  the  k-th  agent 

9k  is  positive  when  (Ok  <  0,  and  it  is  negative  when  (Ok  >  0. 


Let  the  initial  motion  of  the  agents  with  dynamics  (la), 
(lb)  and  (Ic)  be  governed  by  the  open-loop  controls  Uk  = 
Pk  =  0,  for  all  k  =  In  this  situation,  the  k-th  agent 

moves  in  a  circular  orbit  with  angular  frequency  (Ok  about  an 
arbitrary  fixed  center.  We  seek  to  find  the  feedback  controls 
Uk  and  Pk  such  that  the  collective  motion  of  the  agents  is 
stabilized  to  a  common  circle  of  desired  radius  po  =  '  >  0 

and  desired  center  cq  (which  is  fixed)  with  their  phases, 
either  in  synchronized,  in  balanced  or  in  splay  formations. 
Previous  work  in  this  direction  [2]  has  focused  on  achieving 
the  common  circular  motion  about  a  desired  center  when 
the  angular  frequencies  of  the  initial  circular  motions  of 
the  agents,  are  same.  As  an  extension,  in  this  paper,  we 
consider  that  the  angular  frequencies  of  the  initial  circular 
motions  of  the  agents  are  different.  Note  that  the  angular 
frequency  of  the  desired  circular  motion  is  >  0,  therefore, 
in  the  equilibrium,  all  the  agents,  initially  rotating  in  either 
clockwise  or  anticlockwise  directions,  move  in  the  clockwise 
direction  on  the  desired  circle.  Note  that,  this  paper  does  not 
deal  with  issue  of  collision  avoidance  among  agents. 

We  introduce  a  few  more  notations  and  state  a  few 
important  results,  which  are  used  further  in  this  paper. 
We  use  the  bold  face  letters  r  =  €  C^,  9  — 

(01 , . . . ,  9nY  G  where  is  the  V-torus,  which  is  equal 
to  5*  X  ...  X  5*  (V-times),  and  <a  =  (oi , . . . ,  (OnY  ^ 
represent  the  vectors  of  length  N  for  the  agent’s  positions, 
headings  and  angular  frequencies,  respectively.  Next,  we 
define  the  inner  product  (zi,Z2)  of  the  two  complex  numbers 
zi,Z2  G  C  as  (zi,Z2)  =  Re(ziZ2),  where  zi  represents  the 
complex  conjugate  of  zi.  Some  of  the  important  properties  of 
the  inner  product  (•,•),  which  are  relevant  in  the  framework 
of  the  present  paper  can  be  found  in  [19],  and  are  listed 
below: 

PI)  (zi,Zl)  =  |zip 
P2)  {zi,Z2)  =  {Z2,Zl) 

P3)  {izi,Z2)  =  -{zi,iz2) 

P4)  (zi,CZ2)  =c(zi,Z2);  cGK 

P5)  {zi+W,Z2)  =  {zi,Z2)  + {w,Z2)',  WGC 

P6)  ^(zi,zi)  =2(zi,zi) 

These  properties  will  be  used  in  the  next  sections  to 
simplify  the  algebraic  relations. 

III.  Design  of  Control  Laws 

The  problem,  addressed  in  this  paper,  is  solved  in  four 
steps.  At  first,  a  spacing  potential  is  proposed,  the  min¬ 
imization  of  which  leads  to  the  circular  formation  where 
all  the  agents  orbit  the  same  point.  Then,  a  phase  potential 
is  described,  the  minimization  of  which  corresponds  to  the 
balanced  formation,  and  the  maximization  corresponds  to  the 
synchronized  formation.  After  it,  a  potential  function  whose 
minimization  leads  to  the  desired  angular  frequency  of  all 
the  agents  around  a  common  circle,  is  suggested.  Finally, 
the  control  laws  Uk  and  Pk  are  proposed  by  minimizing 
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Fig.  1.  Orientation  of  the  k-th  agent  on  the  desired  circle 

a  composite  Lyapunov  function,  which  combines  all  these 
potentials. 

A.  Achieving  Desired  Circular  Formation 

The  circular  formation  of  all  the  agents  corresponds  to 
their  collective  motion  on  a  common  circle  in  the  same 
direction  of  rotation.  This  situation  is  shown  in  figure  1, 
where  each  agent  rotates  at  a  constant,  unit  speed  in  the 
clockwise  direction  on  a  circle  of  radius  po  and  center  cq. 
The  multiplication  of  the  complex  number  i  to  the  velocity 
vector  e'®*  provides  a  unit  vector  /e'®*,  which  is  perpendicular 
to  the  velocity  vector  e'®*  and  points  away  from  the  center 
CQ.  From  figure  1,  the  position  of  the  k-th  agent  on  this  circle 
is  given  by 

rk  =  co  +  /poe'®*  (2) 

To  stabilize  the  clockwise  circular  motion  with  desired 
angular  frequency  Q.o  —  >0  about  a  desired  center  cq, 

which  is  fixed,  we  introduce  an  eiTor  variable  ek  =  r^  —  (cq  + 
/poe'®*)  for  all  k  =  1 , . . . ,  and  choose  a  candidate  Lyapunov 
function 

|e*P=  kA:-co-/poe'®‘P 

^  k=\  ^  i:=l 

=  t^Y^yk-CQ-  ipoe'®*  ,rk-co-  ipoe'®* )  (3) 

which  is  minimized  when  =  cq  +  ipoe'®*  for  all  k  = 

l,...,iV. 

Taking  the  time  derivative  of  the  Lyapunov  function  (3) 
along  the  dynamics  (la),  (lb)  and  (Ic),  yields 

=  Y  (?•<:- CO -ipoe'®*,e'®*(l-po(®A:-Mi:)))  (4) 

k=\  '  ' 

Using  properties  (P4)  and  (P5)  in  (4),  yields 
A'  /  .  > 

('•i:-co,e'®M(l-po®<:  +  poM*) 

A:=l  '  ' 

A'  ,  .  ,  > 

-  ^Po(^e'®^e'®*)(l-po®,t  +  PoMi)  (5) 

i:=l  '  ' 

Since  (/e'®*,e'®*)  =  0,  therefore  (5)  is  simplified  to 

S{r,d)=  Yyk-co,e‘^n{l-po(ak  +  poUk)  (6) 

k=i  '  ' 


B.  Achieving  Synchronized  and  Balanced  Collective  Motion 
The  average  linear  momentum  of  a  group  of  agents  is  a 

key  control  parameter  in  stabilizing  their  synchronized  and 
balanced  collective  motion.  It  is  maximized  in  synchronized 
collective  motion  and  minimized  in  balanced  collective  mo¬ 
tion.  From  (la),  the  average  linear  momentum,  pe,  of  a  group 
of  A^-agents,  is 

=  (7) 

<r=l 

which  is  also  referred  to  as  the  phase  order  parameter  [20]. 
The  phase  aiTangement  6  is  synchronized  if  the  modulus 
of  the  phase  order  parameter  (7)  equals  one,  that  is,  |pe|  = 
1.  The  phase  aiTangement  6  is  balanced  if  the  phase  order 
parameter  (7)  equals  zero,  that  is,  pe  =0  [21]. 

The  stabilization  of  synchronized  and  balanced  collective 
motions  is  accomplished  by  considering  the  potential  [2] 

t/(0)  =  (iV/2)|pe|2  (8) 

which  reaches  its  unique  minimum  when  pe  =0  (balanced) 
and  its  unique  maximum  when  all  phases  are  identical 
(synchronized).  All  other  critical  points  of  U  are  isolated 
in  the  shape  manifold  T^/5'  and  are  saddle  points  of  U  [2], 
The  time  derivative  of  U,  along  the  dynamics  (la),  (lb) 
and  (Ic),  is 

(9) 

Using  property  (P4),  we  get 

N  .  , 

(10) 

k=l  '  ' 

C.  Achieving  Desired  Angular  Frequency 

The  agents,  initially  rotating  around  individual  circles  with 
different  angular  frequencies,  are  supposed  to  stabilize  their 
collective  motion  on  a  common  circle  with  desired  angular 
frequency  Hq.  To  achieve  the  desired  angular  frequency  flo 
of  the  common  circular  orbit  traversed  by  each  agent,  we 
choose  a  candidate  Lyapunov  function 

1  ^ 

G{(o)^-Y{(Ok-^of  (11) 

^  i:=l 

which  is  minimized  when  cOk  =  Hq,  for  all  k  =  1, . . .  ,N. 

Taking  the  time  derivative  of  G  along  the  dynamics  (la), 
(lb)  and  (Ic),  yields 

N  N 

G{(o)  =  Yi^k-^o)d)k=Y(^k-^o)Pk  (12) 

A:=l  A:=l 

D.  Composite  Lyapunov  Function  and  Control  Laws 

In  this  subsection,  by  constructing  the  composite  Lya¬ 
punov  functions,  the  control  laws  and  pi^  are  proposed  to 
prove  the  stabilization  of  both,  balanced  and  synchronized 
collective  motions  (of  the  agents)  around  a  common  circle 
of  desired  radius  po  =  Hq  '  and  desired  center  co,  which  is 
hxed. 
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Theorem  1:  Consider  the  system  dynamics  (la),  (lb)  and 
(Ic)  with  control  laws 

Uk  =  -Ho  (13) 

Hk  =  -KpQ{cOk-TlQ)-D.oUk.  (14) 

For  K  >0  and  K  >  0,  all  the  agents  asymptotically  stabilize 
to  a  clockwise  circular  motion  of  radius  po  =  *  >  0  about 

a  fixed  center  cq  with  their  relative  phases  in  balanced  state. 
Proof:  Consider  a  composite  Lyapunov  function 

yi(r,0,fi))  =  )c5(r,0)+po^t/(0)+Po^G(fi));  k,K>Q  (15) 

Using  (6),  (10)  and  (12),  the  time  derivative  of  the  Lyapunov 
function  Vi  along  the  dynamics  (la),  (lb)  and  (Ic),  is 

N 

Vi{r,e,(0)  =  KY,{rk-C0,e‘^n{l-pQCOk  +  P0Uk) 

k=l  '  ' 

N 

+K  X  {pe,ie‘^'){-PQ(Ok  +  PQ‘ik) 
k=\  '  ' 

N 

+plY^{(»k-^G)Pk  (16) 

k=\ 

Note  that 

£(pe,le'®‘)  =  -^£  ^  sin(e;-et)  =0  (17) 

k=l  ^  ^  k=lj=l 

Using  (17),  (16)  can  be  rewritten  as 

N 

Vi{r,e,(0)=  ^ 

k=l 

N 

X  (l-poffli  +  po!<i)+Po  X  (18) 

k=l 


Under  the  controls  in  (13)  and  (14),  the  time  derivative  of 
Vi  results  in 

N  N 

Vi  (r,  0,<b)  =  -po^  Y.  “-1^  “  E  <0  (19) 

k=l  k=l 

According  to  LaSalle’s  Invariance  theorem  [22],  all  the 
solutions  of  (la),  (lb)  and  (Ic)  with  the  controls  in  (13) 
and  (14)  converges  to  the  largest  invariant  set  contained  in 

M=  |r,0,<B|K-^rA.-co,e'®*^  =  ; 0)*:  =  noj  . 

for  all  A:  =  1, . . .  ,N.  In  this  set,  the  controls  in  (13)  and  (14) 
evaluates  to  zero,  that  is,  Uk  =  Pk  =  0  for  all  k  =  1 , ,N.  It 
implies  that  M  is  the  largest  invariant  set.  Also,  in  the  set 
M,  dynamics  (lb)  reduce  to 

9k  =  —fio  (20) 

which,  upon  integration,  yields 

Okf)  =  -Q.ot  +  OkiO)  =  ^k{t)  (say)  (21) 

Using  (21),  dynamics  (la)  results  in 

fk  =  (22) 

which,  upon  integration,  yields 

rk{t)=rk{0)  +  ipQe'^k{t)  (23) 


Here,  rk{fS)  and  0jt(O),  are  constants  and  denote  the  position 
and  orientation  of  the  k-th  agent  just  after  stabilization, 
respectively.  Now,  we  differentiate  (13)  with  respect  to  time 
and  obtain 

=0  (24) 

Note  that 


^  (p0 ,  )  =  (^-iflope ,  (e'®* ^  +  ^pe ,  -floe'®* ^ 

Substituting  (21),  (23)  and  (25)  in  (24),  we  get 


=  0 
(25) 


^  (^rkiO)  +  ipoe'^kP)  _  ^  =  0  (26) 

Using  property  (P5)  along  with  the  fact  that 
(^ipQe“^kit) ^g‘<l>k{‘)^  =0,  (26)  simplifies  to 


^(G(0)-co,e'^*W)  =  0  (27) 

Since,  r<,(0)  and  cq  both  are  constants.  Therefore,  (27)  is 
satisfied  only  if 

rk{0)  =  CO  (28) 


for  all  k=  1,...,N.  Substituting  (28)  in  (23),  yields 

ri(f)  =  co  +  /poe''^*W  (29) 


for  all  k=  1,...,N,  which  is  the  position  of  the  k-th  agent 
rotating  around  a  circle  of  radius  po  and  centered  at  co  (see 
Eq.  (2)).  This  implies  that  the  set  of  circular  formations  with 
radius  po  =  fig  ^  and  center  co  is  asymptotically  stable  for 
k,K  >0.  Moreover,  the  potential  U  also  approaches  zero 
due  to  the  non-increasing  nature  of  Vi  (since  Vi  <  0).  As  a 
result,  the  phase  arrangement  of  the  agents,  in  the  set  M,  lies 
in  the  critical  set  of  U  where  pg  =  0  (Phase  balancing).  It 
completes  the  proof.  ■ 

Theorem  2:  Consider  the  system  dynamics  (la),  (lb),  and 
(Ic)  with  control  laws  (13)  and  (14).  For  K  <0  and  K  >  0, 
all  the  agents  asymptotically  stabilize  to  a  clockwise  circular 
motion  of  radius  po  =  fig  '  >  0  about  a  fixed  center  cq  with 
their  relative  phases  in  synchronized  state. 

Proof:  Consider  a  composite  Lyapunov  function 

V2{r,e,(0)  =  KS{r,e)-poK{N/2-U{e)) 

+p^G{a))-  k>0,K<0  (30) 

Note  that  the  magnitude  of  the  average  linear  momentum 
pg  in  (7)  satisfies  0  <  Ipel  <  1,  which  ensures  that  V2  >  0. 
Taking  the  time  derivative  of  V2  along  the  dynamics  (la), 
(lb)  and  (Ic),  yields 

N  N 

V2{r,e,(0)  =  Vi  =  -Po^  E  -  K-Po  E  ^  0 

k=l  k=\ 

Since  V2  =  Vi,  the  proof  follows  the  same  steps  as  used  to 
prove  Theorem  1.  This  concludes  that,  for  all  k=  l,...,N, 
the  set  of  circular  formations  with  radius  po  =  and 
center  cq  is  asymptotically  stable  for  tc  >  0,/r  <  0.  Moreover, 
the  potential  A/2  — U  also  approaches  zero  due  to  the  non¬ 
increasing  nature  of  V2  (since  V2  <  0).  As  a  result,  the  phase 
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arrangement  of  the  agents,  in  the  set  M,  lies  in  the  critical 
set  of  N/2  —  U  where  \pq\  =  \  (Phase  synchronization).  It 
completes  the  proof.  ■ 

IV.  Splay  Phase  Stabilization 


The  splay  phase  is  an  arrangement  in  which  the  agents 
are  uniformly  distributed  around  the  desired  common  circle 
in  a  way  that  their  phases  are  separated  by  multiples  of 
2n/N.  The  m-th  harmonic  of  the  phase  order  parameter  pQ, 
which  plays  an  important  role  in  stabilizing  the  splay  phase 
arrangement,  is  given  by  [1],  [2] 


1 


N 


imQh 


(31) 


where  m  G  N  =  {1,2,3,...}.  The  splay  phase  arrangement 
occurs  when  the  condition 


Pe  =P20  =  •••  =  P[iV/2j0  =0  (32) 

holds  [1],  [2],  where  \N /2\  is  the  largest  integer  less  than 
or  equal  to  N /2.  Condition  (32)  indicates  that  the  splay 
phase  arrangement  corresponds  to  the  phase  balancing  of  the 
first  \N /2\  harmonics  of  pg.  Therefore,  in  order  to  stabilize 
the  splay  phase  arrangements,  we  use  the  potential  function 
given  as. 


N 


LiV/2j 


W(0)  =  y  E  We? 

^  m=l 


(33) 


which  attains  its  minimum  in  the  splay  state.  The  time 
derivative  of  W  along  the  dynamics  (la),  (lb)  and  (Ic),  is 

^  !  dv  a  \ 

^(0)=A^E  E  {pme.^{-(Ok  +  Uk))  (34) 

k=\  m=\  \  ^  / 

Using  property  (P4),  we  get 

N  [N/l] 

w(0)  =  E  E 

k=\  m=l 

Theorem  3:  Consider  the  system  dynamics  (la),  (lb)  and 
(Ic)  with  control  laws 

[N/2\ 


PmeW'^W{-(ak  +  uk)  (35) 


Uk  =  -fio  I  K{rk-co,e' 

Pk  =  —  K'Po(®jt  — fio)  —TlgUk. 


+^E 

m=l 


For  K  >0  and  if  >  0,  all  the  agents  asymptotically  stabilize 
to  a  clockwise  circular  motion  of  radius  po  =  >  0  about 

a  fixed  center  co  with  their  relative  phases  in  splay  state. 
Proof:  Consider  a  composite  Lyapunov  function 

V{r,e,a))  =  KS{r,e)+poKW{e)  +  plG{a))-,  k,K>0  (38) 

Using  (6),  (12)  and  (35),  the  time  derivative  of  V  along  the 
dynamics  (la),  (lb)  and  (Ic),  is 

N 

V{r,e,(0)  =  KY,{rk-co,e‘^'‘){l-pQ(Ok  +  poUf,) 

k=\  '  ' 

N 

+V  E  (-Po®i:+PO“/i:) 

k=\  '  ' 

N 

+Po  E  (39) 

k=l 


Note  that 

N  ■,  N  N 

E  \Pme,ie"’W  = - t:  E  E  sinm(ej  -  Pj.)  =  0  (40) 

k=l  '  '  k=l 

Using  (40),  (39)  can  be  rewritten  as 

V{r,e,(0)  =  £ 


X  ( 1  -  poCOj,  +  PoMi)  +  Po  E  ~  flo)  Pk 

k=l 


Under  the  controls  in  (36)  and  (37),  the  time  derivative  of  V 
results  in 


V{r,0,a)  =  -po^  -  Kp^i  ^{cOk-^lof  <0  (41) 

k=l  k=\ 

According  to  LaSalle’s  Invariance  theorem  [22],  all  the  solutions 
of  (la),  (lb)  and  (Ic)  with  the  controls  in  (36)  and  (37)  converge 
to  the  largest  invariant  set  contained  in 

M'  =  =  fio} 

for  all  k=  In  this  set,  the  controls  in  (36)  and  (37) 

evaluates  to  zero,  that  is,  Uk  =  Pk  =  0  for  all  k  =  1, . . . ,  A.  It  implies 
that  M'  is  the  largest  invariant  set.  Following  similar  analysis  as  used 
to  prove  Theorem  1,  it  is  evident  that,  in  the  set  M' ,  dynamics  (la) 
and  (lb)  give  rise  to  (29).  Therefore,  it  can  be  concluded  that,  for 
all  k  =  1 , . . . ,  A,  the  set  of  circular  formations  with  radius  po  =  * 

and  center  cq  is  asymptotically  stable  for  k.K  >  0.  Moreover,  the 
potential  W  also  approaches  zero  due  to  the  non-increasing  nature 
of  V  (since  V  <  0).  As  a  result,  the  phase  arrangement  of  the  agents, 
in  the  set  M' ,  lies  in  the  critical  set  of  W  where  p^g  =  0  for 
m  =  1,...,[A/2J  (splay  phase  arrangement).  This  completes  the 
proof.  ■ 


V.  Simulation  Results 

In  this  section,  simulations  are  provided  to  validate  the 
theoretical  results  obtained  in  the  previous  sections.  We  ren¬ 
der  the  simulation  results  for  A  =  6  agents  where  their  initial 
positions,  initial  headings  and  initial  angular  frequencies  are 
randomly  generated.  Figure  2  shows  the  stabilization  of  the 
collective  motion  of  the  agents  in  the  clockwise  direction 
around  a  common  circle  of  desired  radius  po  =  =  10 

and  desired  center  cq  =  (5,5).  In  all  figures,  the  trajectory  of 
centroid  is  shown  by  a  dashed  line. 

Figures  2(a)  and  2(h)  depict  the  collective  circular  mo¬ 
tions  in  the  balanced  and  synchronized  phase  arrangements, 
respectively,  which  are  obtained  under  the  controls  (13)  and 
(14).  For  phase  balancing,  we  set  the  controller  gains  as 
K  =  0.5  and  if  =  0.1,  whereas,  for  phase  synchronization, 
we  set  K  =  —0.5  and  if  =  0.1.  In  figure  2(c),  the  collective 
motion  in  the  splay  state  is  shown,  where  the  agents  are 
spread  out  equidistantly  on  the  desired  common  circle  and 
have  an  angular  separation  of  60°.  The  splay  formation  is 
obtained  under  the  controls  (36)  and  (37)  for  controller  gains 
K  —  0.5  and  if  =  0.1.  Note  that,  in  the  figures  2(a)  and 
2(c),  the  final  position  of  the  centroid  of  the  group  coincides 
with  the  center  cq  =  (5,5)  of  the  common  circle.  It  happens 
because  of  the  fact  that,  in  balanced  and  splay  formations, 
the  linear  momentum  pg  =  0,  which  causes  (2)  to  reduce  to 
Co  =  /N)Y!k=i^k,  which  is  the  average  position  of  all  the 

agents,  i.e.  the  position  of  their  centroid. 
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Fig.  2.  Stabilization  of  N  =  6  agents  on  the  common  circle  of  desired  radius  po  =  £2q  *  =  10  and  desired  center  cq  =  (5,5)  in  the  symmetric  patterns  of 
their  phases,  {a)  Under  the  control  laws  (13)  and  (14)  with  K  =  0.5  and  K  =  0.1.  {b)  Under  control  laws  (13)  and  (14)  with  K  =  —0.5  and  K  =  0.1.  (c) 
Under  control  laws  (36)  and  (37)  with  K  =  0.5  and  K  =  0.1. 


VI.  Conclusions 

In  this  paper,  a  control  scheme,  which  consists  of  two  feed¬ 
back  controllers,  has  been  proposed  to  stabilize  the  collective 
motion  of  a  group  of  V-identical  agents  around  a  desired 
common  circle  with  their  phases  either  in  synchronization, 
in  balanced,  or  in  splay  formations.  One  of  the  controllers 
controls  the  heading  and  the  other  controller  controls  the 
angular  frequency  of  each  agent.  These  feedback  controls 
have  been  derived  from  composite  Lyapunov  functions, 
which  reach  their  minimum  in  the  desired  configuration  of 
the  collective  motion.  It  has  been  shown  that  the  closed- 
loop  system  is  asymptotically  stable  under  the  action  of  these 
feedback  control  laws. 
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Reachability  of  Agents  with  Double  Integrator  Dynamics  in  Cyclic 

Pursuit 


Dwaipayan  Mukherjee  and  Debasish  Ghose 


Abstract — Some  recent  work  on  cyclic  pursuit  systems  with 
double  integrator  dynamics  has  probed  the  stability  of  certain 
proposed  laws  and  investigated  the  stability  of  several  forma¬ 
tions  for  such  a  system  of  agents.  Some  of  these  laws  use  the 
relative  position  information  of  two  leading  neighbors,  instead 
of  one  as  in  case  of  single  integrator  dynamics.  In  some  others 
the  relative  position  of  only  one  leader  is  used  along  with  its 
relative  velocity  and  a  damping  term.  In  this  paper,  a  new  law  is 
proposed  which  guarantees  stability.  An  algorithm  is  proposed 
which  enables  rendezvous  of  the  agents  at  any  desired  point 
in  the  two-dimensional  space.  The  gains  corresponding  to  each 
agent  are  different  and,  along  with  their  initial  velocities,  are 
considered  to  be  the  decision  variables.  The  theoretical  results 
are  backed  by  simulation  studies. 

I.  Introduction 

In  conventional  cyclic  pursuit  with  single  integrator  dy¬ 
namics,  each  agent  i  pursues  its  leader  i  +  1  modulo  n, 
where  n  is  the  total  number  of  agents.  Some  results  on 
the  set  of  reachable  points  for  such  agents,  where  they  may 
rendezvous,  are  available  in  the  literature  [1].  However,  they 
consider  single  integrator  dynamics,  wherein  the  velocity  of 
agent  i  is  proportional  to  the  distance  separating  the  agent 
from  its  leader  i  +  1  and  is  in  a  direction  along  the  vector 
joining  i  and  i+\.  Formation  stability  for  such  agents  in 
cyclic  pursuit  have  also  been  analyzed  [2].  In  [I]  it  has 
been  shown  that  the  gains  can  be  heterogeneous  and  at  most 
one  of  the  gains  can  be  negative  (with  a  lower  bound), 
thereby  enabling  rendezvous  at  almost  any  point  in  the  state 
space,  except  in  some  diagnostic  cases.  Some  other  aspects 
of  the  consensus  problem  have  also  received  attention  in  the 
literature  [3].  In  general,  the  consensus  problem  in  multi¬ 
agent  systems  is  important  as  the  agents  may  be  required  to 
achieve  identical  values  in  the  absence  of  a  central  controller 
to  instruct  them. 

In  [4],  it  has  been  stated  that  double  integrator  dynamics 
are  more  suited  to  capturing  the  model  of  Unmanned  Air 
Vehicles  (UAVs),  while  single  integrator  dynamics  suffice  to 
capture  the  model  of  a  Unmanned  Ground  Vehicle  (UGV). 
In  [5],  the  existing  cyclic  pursuit  laws  for  single  integrator 
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dynamics  have  been  extended  to  consider  double  integrator 
dynamics,  which  necessitate  the  relative  position  and  veloc¬ 
ity  information  of  two  neighboring  agents  instead  of  one. 
However,  the  objective  of  [5]  was  to  ensure  stable  evenly 
spaced  circular  formation  or  evenly  spaced  Archimedean 
spiral  formations.  Collective  rotating  motion  of  second  order 
multi-agent  systems  are  also  considered  in  [6].  But,  here  also 
the  primary  interest  was  to  investigate  the  stability  of  forma¬ 
tions  rather  than  achieving  positional  consensus.  In  [7]-[8], 
conditions  on  Euler  angle  and  damping  gain  are  investigated 
for  an  existing  algorithm  with  double  integrator  dynamics, 
that  result  in  rendezvous,  circular  motion  or  movement  along 
a  logarithmic  spiral.  Co-operative  target  tracking  through 
desired  formations,  using  a  double  integrator  robot  model,  is 
studied  in  [9].  Stable  vehicular  formations  are  also  studied 
in  [10]  for  both  single  and  double  integrator  dynamics.  In 
particular,  formation  patterns  for  agents  in  cyclic  pursuit 
(with  double  integrator  dynamics)  are  probed  in  [11].  For 
agents  with  directed  acyclic  graphs,  collective  motion  and 
formation  patterns  are  investigated  in  [12].  In  [13]  deviated 
linear  cyclic  pursuit  has  been  studied  and  the  conditions 
for  stability  have  been  derived  assuming  both  heterogeneous 
gains  and  deviations  of  the  agents.  It  has  been  shown  that 
using  heterogeneous  gains  and  deviations,  rendezvous  is 
possible  at  certain  points  outside  the  convex  hull  of  the  initial 
positions  of  the  agents,  which  are  not  reachable  by  any  other 
known  cyclic  pursuit  strategy.  However,  not  all  points  are 
reachable  and  the  dynamics  of  the  agents  are  considered  to 
be  of  single  integrator  type. 

In  the  present  work,  agents  with  double  integrator  dynam¬ 
ics  have  been  considered.  These  agents  may  have  different 
gains  and  initial  velocities.  Depending  on  the  choice  of 
gains  and  initial  velocities  (which  are  the  decision  variables 
for  the  proposed  algorithm),  it  is  proved  that  positional 
consensus  can  be  achieved  at  any  desired  point  in  the  two- 
dimensional  space.  This  same  goal  might  have  been  achieved 
by  incorporating  the  information  about  the  desired  goal 
point  into  the  control  signal.  But  this  would  have  implied 
additional  information  which  is  extrinsic  to  the  agents,  that 
is  not  directly  related  to  the  agents  position  or  velocity. 
The  results  are  proved  using  techniques  of  matrix  theory, 
[14]  that  involve  estimating  the  regions  within  which  the 
eigen-values  of  a  system  may  lie.  The  case  of  level  flight  is 
considered  with  no  variation  in  altitude.  Hence,  rendezvous 
in  two  dimensions  is  sufflcint  for  positional  consensus. 

The  paper  is  organized  in  the  following  manner.  In  Section 
II,  a  control  law  is  proposed  for  agents  with  double  integrator 
dynamics  in  cyclic  pursuit  and  the  stability  of  the  same  is 
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investigated.  Section  III  shows  that  the  reachability  set  using 
this  control  law  includes  any  point  in  the  two  dimensional 
space.  A  motivating  example  has  been  presented  to  illustrate 
the  limitation  of  existing  cyclic  pursuit  schemes  (with  single 
integrator  dynamics)  with  respect  to  reachability.  In  Section 
IV,  an  algorithm  is  proposed  to  choose  the  decision  variables 
depending  on  the  desired  point  of  convergence  (rendezvous). 
In  Section  V,  the  theoretical  results  in  the  earlier  sections  are 
backed  by  numerical  examples  and  corresponding  simulation 
results.  Section  VI  concludes  the  paper  by  suggesting  some 
directions  along  which  future  studies  may  be  focussed. 

II.  Control  Law  for  Double  Integrator 
Dynamics 


Fig.  1.  The  Cyclic  Pursuit  Scheme. 


Consider  the  dynamics  of  agent  i  (modulo  n)  given  by: 


Zi  =  V;  (1) 

Vi  =  Ui  (2) 

Ui  =  ki{zi+\-Zi)-2y/kiVi-,  ki>Q\l  i  (3) 


where,  Zi  6  C  denotes  the  position  of  agent  i  and  v,-  e  C 
its  velocity.  As  with  conventional  cyclic  pursuit,  where  each 
agent  has  information  about  only  one  of  its  neighbors, 
(depicted  in  Fig.  1)  here  also  the  same  scheme  of  information 
exchange  holds.  Since  the  motion  along  the  x  and  y  directions 
are  decoupled  and  similar,  it  suffices  to  replace  Zi  by  a,-  6  K 
and  V/  by  6  K  in  (l)-(3),  for  the  purpose  of  investigation. 
The  same  dynamics  is  valid  along  the  y-direction.  The  system 
dynamics  can  thus  be  written  in  compact  form  as: 


w 

w 

A 


P 


Q 


Aw,  w  e  A  6 

[xi  X2  ...  X„  vi^  V2^  ...  Vn^f 


/  -ki  ki  ...  0  \ 

0  -k2  ...  0 


\  K  0  ...  -kn  ) 

diag{-2y/k~i  -2y/k^  ...  -2\/]i„) 


(4) 

(5) 

(6) 

(7) 

(8) 


where,  diag{)  represents  the  elements  along  the  diagonals 
of  a  diagonal  matrix.  The  choice  of  —2y/ki  as  a  damping 
term  ensures  that  a  system  of  order  2n  can  be  charac¬ 
terized  by  n  parameters  only  and  this  makes  the  analysis 


tractable.  Furthermore,  these  n  parameters  (that  is,  ki  Vi) 
are  sufficient  to  ensure  rendezvous  at  any  desired  point  in 
the  two-dimensional  space,  as  will  be  illustrated  later.  In 
order  to  investigate  the  stability  of  the  control  law  proposed 
above,  the  characteristic  polynomial  corresponding  to  the 
system  given  by  (4)-(8)  needs  to  be  studied.  Let  r{s)  be  the 
characteristic  polynomial  given  by: 

ris)  =  da{sl2n  -  A)  =  det  j  (9) 

Since  the  blocks  in  the  first  row  block  of  {sl2„—A)  commute, 
in  accordance  with  [15],  the  expression  for  r{s)  can  be 
written  as: 

r{s)  =  dsi[{sln-  Q)sln-  Pin]  =  X\{s  +  \/kif  -Y[ki  (10) 

i  i 

From  (10),  it  is  obvious  that  the  characteristic  equation 
r{s)  =  0  has  a  root  at  the  origin.  If  the  nullity  of  A  is  unity,  it 
implies  that  the  non-trivial  null  space  of  A  is  spanned  by  the 
vector  [11...  1  00...  0]^  as  A  has  only  one  eigen-value 

n  n 

at  the  origin.  Furthermore,  if  all  the  other  eigen-values  of  A 
are  in  the  open  left  half  plane,  then,  by  the  same  arguments 
as  presented  in  [l]-[2],  the  system  is  stable  and  positional 
consensus  will  be  reached  asymptotically.  From  the  null 
vector,  it  can  also  be  deduced  that  the  velocities  of  the  agents 
will  be  zero  at  steady  state.  In  order  to  investigate  the  stability 
of  A,  another  matrix  having  the  same  characteristic  equation. 


r{s),  given  by 

H  e  R2nx2«  considered: 

/ 

—  \/h 

Vh 

0 

0  \ 

0 

—y/h 

y/Fi 

0 

H  = 

(11) 

0 

0 

1 

y/kfi 

0 

-y/j^n  ) 

The  fact  that  H  has  the  same  characteristic  equation,  r{s), 
can  be  verified  by  the  principle  of  mathematical  induction 
by  checking  for  n  =  1,2  and  then  assuming  the  pattern  to 
hold  for  n  =  m,  it  can  be  checked  that  it  holds  for  n  =  m-|-  1. 
Upon  a  direct  application  of  Gershgorin’s  theorem,  [6],  as 
in  [1],  it  is  apparent  that  except  for  one  eigen- value  at  the 
origin,  all  the  other  the  eigen-values  of  H  must  lie  within 
the  open  left  half  plane.  Since  H  and  A  have  the  same 
characteristic  equations,  their  eigen-values  must  be  the  same. 
Thus,  the  matrix  A  must  also  have  exactly  one  eigen-value 
at  the  origin  and  all  other  eigen-values  in  the  open  left  half 
plane.  Therefore,  stability  of  the  system  is  guaranteed  with 
the  control  law  proposed  in  (3).  This  ensures  rendezvous. 
In  view  of  the  above  discussion,  the  following  theorem  may 
now  be  stated. 

Theorem  1:  Consider  the  system  given  by  (4)-(8),  with  the 
control  law  as  in  (3).  The  system  has  exactly  one  eigen-value 
at  the  origin  and  all  other  eigen-values  in  the  open  left  half 
plane,  thereby  ensuring  stability  and  positional  consensus  of 
the  multi-agent  system. 

Proof:  Consider  the  matrix  H  in  (11).  Corresponding 
to  each  row  of  H,  a  Gershgorin  disc  may  be  constructed  with 
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Fig.  2.  Gershgorin  discs  corresponding  to  each  row  of  H. 


its  center  at  (— v^,0)  and  radius  equal  to  as  shown  in 
Fig.  2.  Since  each  gain  ki  appears  in  two  rows,  there  are 
effectively  n  distinct  discs  at  most  (assuming  all  the  gains 
are  different).  Now,  by  Gershgorin’s  Theorem  [14],  all  the 
eigen-values  of  the  matrix  H  must  lie  within  the  union  of 
these  discs.  Since  all  these  discs  lie  within  the  left  half  plane 
(except  for  the  origin),  the  eigen-values  of  H  must  be  in  the 
left  half  plane  too  and  thus  the  characteristic  equation  of 
H  must  have  all  its  roots  in  the  same  region.  This  same 
characteristic  equation  r{s)  is  shared  by  the  matrix  A  and  so 
the  same  conclusions  can  be  drawn  about  the  eigen-values  of 
A.  An  inspection  of  r'(j),  (the  derivative  of  r(i)  with  respect 
to  j)  reveals  that  it  does  not  have  a  root  at  zero.  Thus  r{s) 
has  only  one  root  at  the  origin  and  no  repeated  roots  there. 
According  to  [16],  each  co-ordinate  of  the  solution  to  the 
initial  value  problem  (4)  is  a  linear  combination  of  functions 
of  the  form  cosbit  or  sinbjt,  where  A;  =  a,  +  jb,  is 
an  eigen-value  of  the  matrix  A,  and  (0  <  <  n  —  1)  is  the 

algebraic  multiplicity  of  the  eigen-value  A,,.  Thus,  all  these 
components  will  decay  at  steady  state  because  a,-  <  0  Vi, 
except  for  the  component  corresponding  to  the  zero  eigen¬ 
value.  Hence,  the  null  vector  (eigen-vector  corresponding  to 
the  zero  eigen-value)  determines  the  steady  state  behaviour. 
From  the  null  vector  [1  1  ^...  1  0  0  ...  0]^,  it  is  clear  that 

n  n 

at  steady  state  positional  consensus  is  achieved  with  zero 
velocity.  This  is  also  in  accordance  with  the  results  in  [1], 
[2].  ■ 


III.  Analysis  of  Reachable  Set 

The  following  example  illustrates  the  limitations  of  hetero¬ 
geneous  cyclic  pursuit  [1],  with  single  integrator  dynamics, 


Fig.  3.  Desired  Rendezvous  point  for  single  integrator  dynamics. 


in  terms  of  reachability. 

A  Motivating  Example:  Consider  3  agents  starting 
from  the  vertices  of  an  isosceles  right  angled  triangle  at 
[(0,0),  (r/,0),  (t/jii)]  as  shown  in  Fig.  3.  Suppose  the  desired 
rendezvous  point  is  such  that  its  abscissa  is  greater  than  d 
and  its  ordinate  is  between  0  and  d.  Let  the  gains  for  the 
agents  be  ki.  The  co-ordinates  of  the  rendezvous  point  may 
be  written  as  id  +  £,fid),  where  E  >  0  is  any  positive  real 
number  and  0  </3<l.  Suppose  that  p  =  p,  without  loss 
of  generality.  This  quantity  p  may  be  suitably  chosen  to  scale 
up  or  scale  down  the  gains.  It  is  known  from  [1]  that  the  point 
of  convergence  of  the  agents  in  cyclic  pursuit  is  given  by 


Zr  = 


Ln  Zio 
<=1  kj 
yn  ' 

■Lp=l  k„ 


where  Zy  is  the  co-ordinate  of  the  rendezvous  point  denoted 
by  a  complex  number  and  zm  is  similarly  the  initial  position 
of  agent  i.  In  accordance  with  this,  the  following  equations 
may  now  be  written  for  rendezvous  of  the  agents  at  the 
desired  location: 


d  d 

ki  kj, 

d 

h 


{d  +  e)p 
pdp 


It  is  obvious  that  the  values  of  ^  are  given  by 

_p£ 

d 

p(l  +  ^/3) 

P/3. 

Now,  depending  on  the  sign  of  p,  two  cases  may  arise. 
If  p  <  0,  two  of  the  gains,  k2  and  kj,,  become  negative, 
thereby  violating  the  conditions  for  stability  and  ruling  out 
rendezvous  [1].  On  the  other  hand,  if  p  >  0,  only  ky  <  0, 
but  multiplying  both  sides  of  the  inequality,  ^  >  0,  by  the 
negative  quantity  k\k2ki,  it  is  easy  to  see  that  kik2  +  k2k2  + 


1 

ki 

1 

h 

1 
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k-iki  <  0.  According  to  [1],  in  the  third  order  characteristic 
equation  corresponding  to  this  system,  the  coefficient  of  s 
is  k\k2  + k2ki  +  k^k\.  Therefore,  the  last  inequality  again 
implies  instability  and  consequent  failure  of  the  agents  to 
converge  to  a  point.  Thus,  it  may  be  concluded  that  no  known 
cyclic  pursuit  scheme  with  single  integrator  dynamics  can 
ensure  rendezvous  at  the  desired  point.  The  deviated  cyclic 
pursuit  scheme  presented  in  [13]  does  enable  rendezvous 
at  certain  points  outside  the  convex  hull  of  the  initial  co¬ 
ordinates,  but  the  distance  of  the  point  of  convergence  from 
the  convex  hull  is  restricted  by  the  limits  on  the  permissible 
deviations  discussed  therein.  □ 

From  (l)-(3),  the  following  may  be  written  after  a  simple 
algebraic  manipulation  (replacing  Zi  6  C  by  a:,-  6  R  ); 


Xi  -I-  2y^iXi 

- -  =  Xi+l  -  Xi 


(12) 


Upon  summation  of  both  sides,  with  index  determined  as 
modulo  n,  the  following  expression  is  obtained: 


n 


I 


Xi  +  2^/kiXi 
ki 


=  0 


(13) 


Integrating  (13)  over  the  interval  to  (initial  time)  to  tf  (final 
time),  it  is  apparent  that: 

^^Xi{tf) -\-2-\/lciXi{tf^  _ ^^Xi{t()) -\-2\n<iXi[to)  (14) 

1=1  i=i 


Now,  at  t  =  tf,  Xi{tf)  =  0,  V  i,  and  =  Xf,  V  i,  as  are 
evident  from  the  null  vector  obtained  in  the  previous  section. 
Thus,  the  point  of  convergence  is  given  by: 


v-n  Xi{tQ)+2^^t]qXi(tQ) 
i-i=l  ki 

■^<=1 


(15) 


It  may  be  noted  that  this  point  of  convergence  is  a  sum  of 
two  terms,  one  of  which  is  a  point  inside  the  convex  hull 
of  the  initial  positions  of  the  agents  ;^) 

and  the  other  term  (X5Li  ®  function  of  the 

initial  velocities  of  the  agents  and  the  gains  chosen.  If  the 
initial  velocity  of  at  least  one  agent  may  be  chosen  at  will, 
it  is  clear  that  Xf  may  assume  any  value.  Hence,  it  is  this 
second  term  that  enables  global  reachability.  The  following 
theorem  may  now  be  stated. 

Theorem  2:  Consider  the  system  given  by  (4)-(8),  with 
the  control  law  as  in  (3).  The  system  of  agents  can  be  made 
to  converge  to  any  point  in  the  two-dimensional  space  using 
a  suitable  choice  of  gains,  ki  and  initial  velocities,  x;(to)  and 
y;(/o)-  The  point  of  convergence  {Xf,Yf)  is  given  by: 


Proof: 

guaranteed. 


Xf  = 


Yf  = 


^'=1  fki 


+ 


\'n  ^/(^o) 

Iki 


Ln  1  -^n  1 

^■=1  ./¥:  ./E 


(16) 


fki 

yfi 


1 


+ 


Vh 

Ln  y/C^o) 

/=!  Ikj 
yn  1 
y/ki 

rendezvous  of  the  agents  is 


(17) 


=  '  Vki 

From  Theorem  1, 

Thus,  the  point  of  convergence  derived  above 


is  the  point  where  the  agents  rendezvous.  It  only  remains 
to  be  shown  that  the  entire  two  dimensional  space  can  be 
reached.  Consider  a  desired  point  {Xd,Yd)  where  the  agents 
must  rendezvous.  Let  the  point  of  convergence  with  zero 
initial  velocities  of  all  agents  be  given  by  (Xi,Ti),  where, 

y.  —  V"  Xiha)  /srn  _L  nnrl  V.  —  V"  MlStl  /  y«  _L  r'nn 
“ ^'=1  / •^'=1  Vfi  “ ^<=1  ^i  / ^<=1  fki' 

sidering  only  the  motion  along  the  x-direction  (the  same 

reasoning  can  be  extended  along  the  y-direction),  let  the 
initial  velocities  of  all  but  one  agent  be  zero.  The  agent  /  with 
non-zero  initial  velocity  may  have  an  initial  velocity  given 
by  (Xj  —  Xi)  X  ^4=1  X  2k;.  Plugging  this  expression  for 
x;(to)  in  (16),  it  is  easy  to  see  that  Xf  =Xj.  This  completes 
the  proof.  ■ 


IV.  An  Algorithm  to  Ensure  Global 
Reachability 

In  the  previous  section  it  was  shown  that  any  point  on  the 
two  dimensional  space  may  be  reached  provided  at  least  one 
of  the  agents  has  a  suitably  chosen  non-zero  initial  velocity. 
However,  in  practice,  the  agents  generally  start  from  rest  and 
if  they  have  a  non-zero  velocity  then  their  position  will  vary 
in  accordance  with  the  governing  equations.  Thus,  the  initial 
position  may  not  be  as  desired.  One  way  of  circumventing 
this  problem  is  to  give  one  of  the  agents  a  dithering  motion 
prior  to  the  start  of  the  cyclic  pursuit  phase.  It  is  proposed 
to  split  the  reachability  problem  into  two  phases.  In  the 
first  phase,  one  of  the  agents  executes  small  oscillations 
of  suitably  chosen  frequency  about  its  mean  position.  In 
the  next  phase  the  cyclic  pursuit  law  is  executed,  so  as  to 
rendezvous  at  a  desired  location.  The  algorithmic  steps  are 
outlined  below: 

1)  Pick  up  an  agent  whose  initial  position  Z;o  (given  by 
(X;o,Uo))  is  closest  to  the  desired  point  Zf  (given  by 
{Xf,Yf))  of  convergence,  that  is,  i  corresponding  to 
which  ||Z;o  — Zy||2  is  minimum.  Suppose,  this  corre¬ 
sponds  to  agent  /,  without  any  loss  of  generality. 

2)  Assuming  the  initial  velocities  to  be  zero,  the  set  of 
gains  may  be  chosen  to  rendezvous  at  a  point  (Xi,yi), 
arbitrarily  close  to  the  initial  co-ordinates  of  agent  1. 
Clearly  this  choice  is  non-unique,  so  the  gains  may  be 
suitably  scaled  by  the  designer.  As  a  good  thumb  rule, 

^  =  1  may  be  an  imposed  constraint.  Of  course, 
any  other  value  of  the  sum  would  have  served  the 
purpose  too. 

3)  Next,  the  initial  velocity  of  agent  I  needs  to  be  chosen. 
Suppose  the  velocity  of  agent  I  along  the  x  direction, 
prior  to  the  initiation  of  the  cyclic  pursuit  scheme,  is 
given  by: 

Vix  =  Aix  sm{coiJ  +  (18) 

This  is  chosen  to  be  a  sinusoid  to  ensure  that  the  agent 
/  does  not  drift  away  from  its  initial  position.  Rather, 
it  executes  a  simple  harmonic  motion  about  its  mean 
position.  A  similar  choice  is  made  for  velocity  along 
the  y  direction. 

4)  Depending  on  the  permissible  level  of  oscillations  in 
position,  the  choice  of  the  ratio  Aix/ciix  is  made. 
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because  this  ratio  corresponds  to  the  maximum  shift 
in  position  for  the  agent  I,  about  its  mean  position. 

5)  The  parameters  Aix,  COix  and  0;^:  (correspondingly  Aiy, 
(Oiy  and  (ply)  need  to  be  chosen.  At  f  =  to,  the  velocity 
must  be  given  by 

"  1 

Aixsm(couto  +  (pix)  =  (Xf-Xi)  x  ^  ^  x  Ik/.  (19) 

,=1  V*i' 

Thus,  for  a  given  to  (starting  instant),  Ai^,  COix  and 
(j>ix  may  be  chosen  to  satisfy  (19)  and  ensure  small 
oscillations  about  the  mean  position  of  agent  1. 

It  should  be  noted  that  this  algorithm  works  with  n  +  6 
decision  variables  (w  gains  and  three  terms  each  correspond¬ 
ing  to  velocities  along  x  and  y  directions).  But  the  system 
order  is  2n  with  n  agent  positions  and  n  agent  velocities 
corresponding  to  the  n  agents.  The  terms  (pi^  and  (piy  ensure 
that  even  if  sin(a);^fo)  or  sin(tt)/j,fo)  are  zeros,  the  initial 
velocity  of  agent  /  does  not  become  zero.  This  could  also  be 
ensured  by  suitably  modifying  (Ou  or  (Oiy  as  per  requirement, 
but  the  additional  terms  (pix  and  <piy  enable  an  independent 
choice  of  the  ratio  Aix/Wu  to  ensure  small  oscillations. 

V.  Simulation  Results 

Example  7:  Consider  a  system  of  four  agents  starting 
from  the  vertices  of  a  square  (0,0),  (3,0), (3, 3),  (0,3).  It  is 
desired  that  the  agents  should  rendezvous  at  the  point  (10,7). 
According  to  the  first  step  of  the  algorithm  outlined  in  the 
previous  section,  agent  3  is  closest  to  the  desired  point  of 
convergence.  Now,  the  gains  are  chosen  assuming  zero  initial 
velocities.  Thus,  the  point  (Xi,Ti)  of  step  2  may  be  chosen 
as  (2.9, 2.9).  One  choice  of  gains  is  [3600  3600  1.108  3600], 
which  results  in  Xi =  1  •  As  pointed  out  in  the  previous 
section,  the  choice  of  the  gains  is  not  unique  and  the 
particular  choice  in  this  example  is  not  sacrosanct.  Now, 
agent  3  must  execute  a  sinusoidal  motion  about  its  initial 
position  (3,3)  prior  to  the  initiation  of  the  cyclic  pursuit 
phase  while  the  other  agents  are  stationary.  If  the  amplitude 
of  oscillation  is  restricted  to  0.1  for  agent  3,  the  ratio  of 
amplitude  to  frequency  (A^x/ (^x  and  A^y/o>iy)  must  be  less 
than  0.1.  If  to  =  li,  it  is  clear  that  A3;c  =  15.734,  A3y  =  9.086, 
(Oix  =  (Oiy  =  200  and  (p^x  =  (p3y  =  nfl  —  200  satisfy  (19).  This 
particular  choice  also  ensures  that  at  t  =  to,  the  position  of 
agent  3  is  (3,3).  The  additional  terms  (pjx  and  (p^y  have  been 
used  to  this  end.  Fig.  4  shows  the  trajectories  of  the  four 
agents  which  converge  at  the  desired  point.  The  square  shown 
in  bold  lines  is  the  convex  hull  of  the  initial  positions  of  the 
agents.  Fig.  5  and  Fig.  6  show  that  after  li  the  cyclic  pursuit 
is  initiated  and  prior  to  that  only  agent  3  executes  small 
oscillations  about  its  mean  position.  It  may  be  noted  that 
even  with  positive  gains,  it  is  possible  to  converge  outside 
the  convex  hull  of  the  initial  co-ordinates  of  the  agents. 

Example  2:  In  this  example  all  conditions  and  design 
parameters  are  kept  the  same  as  in  example  1  except  the 
value  of  A3y,  which  is  changed  to  —2.437.  This  results  in 
a  rendezvous  at  the  point  (10,1.8),  as  shown  in  Fig.  7.  It 
may  be  noted  that  this  point  will  not  be  reachable  using 
conventional  cyclic  pursuit  with  single  integrator  dynamics. 


Fig.  4.  Agents  converging  to  a  desired  point  in  Example  1. 


Fig.  5.  Consensus  in  X  co-ordinates  for  Example  1. 
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Fig.  6.  Consensus  in  Y  co-ordinates  for  Example  1. 
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even  if  a  negative  gain  is  used  as  in  [1].  This  is  because 
this  point  does  not  belong  to  the  union  of  the  convex  hull  of 
initial  co-ordinates  and  the  cones  formed  by  them  as  defined 
in  [1].  However,  the  present  scheme  enables  rendezvous  at 
any  point. 
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nate  Coupling,  IEEE  Transactions  on  Automatic  Control,  Vol.  54,  No. 
6,  June  2009,  pp.  1330-1335. 

[9]  L.  Ma  and  N.  Hovakimyan,  Vision-Based  Cyclic  Pursuit  for  Coopera¬ 
tive  Target  Tracking,  Proceedings  of  the  American  Control  Conference, 
2011,  pp.  4616-4821. 

[10]  F.  Lin,  M.  Fardad,  and  M.  R.  Jovanovic,  Optimal  Control  of  Vehicular 
Formations  With  Nearest  Neighbor  Interactions,  IEEE  Transactions  on 
Automatic  Control,  Vol.  57,  No.  9,  September  2012,  pp.  2203-2218. 

[11]  J.  C.  Juang,  On  the  Formation  Patterns  in  Cyclic  Pursuit  of  Double- 
Integrator  Agents,  Proceedings  of  51  st  IEEE  Conference  on  Decision 
and  Control,  2012,  pp.  5924-5929. 

[12]  W.  Ding,  G.  Yan,  and  Z.  Lin,  Collective  motions  and  formations  under 
pursuit  strategies  on  directed  acyclic  graphs,  Automatica,  46,  (2010) 
pp.  174-181. 

[13]  D.  Mukherjee  and  D.  Ghose,  Generalization  of  Deviated  Linear  Cyclic 
Pursuit,  in  Proceedings  of  the  American  Control  Conference,  2013  pp. 
6163-6168. 

[14]  R.  A.  Horn  and  C.  R.  Johnson,  Matrix  Analysis,  1st  edition  (reprint), 
Cambridge  University  Press,  1990,  pp.  343-353. 

[15]  J.  R.  Silvester,  Determinants  of  Block  Matrices,  Math.  Gazette,  10 
(2000),  pp.  460-467. 

[16]  L.  Perko,  Differential  Equations  and  Dynamical  Systems,  Third  Edi¬ 
tion,  Springer,  2001,  pp.  1-50. 


Fig.  7.  Agents  converging  to  a  point  outside  convex  hull  or  cones  as 
defined  in  [1]  in  Example  2. 


VI.  Conclusions 

In  this  work,  agents  with  double  integrator  dynamics  in 
cyclic  pursuit  have  been  analyzed  and  a  control  law  has  been 
proposed.  The  stability  of  the  proposed  law  has  been  proved. 
The  expansion  of  the  reachable  set  has  been  studied  and 
demonstrated  through  simulation  results.  It  is  proved  that  any 
point  in  the  two-dimensional  space  is  reachable  for  arbitrary 
initial  configuration  of  agents.  A  two  step  algorithm  has  been 
proposed  to  reach  arbitrary  locations  in  the  two  dimensional 
space.  In  future,  research  may  be  directed  towards  converging 
to  a  desired  trajectory,  where,  the  point  of  convergence  may 
be  generalized  to  a  predetermined  trajectory. 
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